A digestion of the Jacobian conjecture counterexample

(terrytao.wordpress.com)

179 points | by jeremyscanvic 5 hours ago

11 comments

  • vanderZwan 3 hours ago
    > While this is an extremely quick verification, the construction presented in this fashion appears like a massive miracle. The polynomial {F} has degree seven, so a priori the Jacobian {\mathrm{det} DF} ought to be a polynomial in three variables of degree as large as {3 \times 6 = 18}, so the fact that all non-constant coefficients of this polynomial vanish looks like a massive cancellation involving {\binom{18+3}{3}-1 = 1329} coefficients, which is much larger than the {\binom{7+3}{3} = 120} degrees of freedom for a generic degree seven polynomial of three variables. So finding such a polynomial looks highly unlikely to be located by brute force.

    Sounds like the most interesting part would be learning what approaches the LLM did use to see if that's reusable elsewhere. I'm guessing that's what the rest of the article is about? Because I also couldn't follow the maths any more.

    • j2kun 37 minutes ago
      I was reading another source that claimed this example was inspired by an existing (rational polynomial) example from the literature (created in 1999 by a Russian mathematician Vitushkin).

      > The seed is almost certainly Vitushkin's old rational "counterexample."

      From https://claude.ai/share/22abed98-d9af-43c5-9881-b19e009a07b0

      This is not quite lore laundering, but it seems to be close.

  • tptacek 4 hours ago
    The introduction to this piece was easy to follow, but as soon as he got into recapitulating it with algebra he lost me (because I'm bad at math). But he includes the GPT5 prompts for his conversation, which are easier to follow:

    https://chatgpt.com/share/6a5fdc7a-d6f8-83e8-bbea-8deb42cfed...

    • minimaxir 4 hours ago
      Also note the timestamp: he started working on this thread a few hours after the tweet.
    • CamperBob2 1 hour ago
      I like how he goes one-on-one with it like Gandalf fighting Yoda on fifteen planes at once for 80% of the transcript, and then we read "OK, I've activated Pro."
    • foobarqux 4 hours ago
      [flagged]
      • hackinthebochs 3 hours ago
        A news aggregator is a community above all. Upvoting content that you may not personally be interested in but will attract the right people is a net benefit for the community[1].

        [1] https://news.ycombinator.com/item?id=44575026

      • Jtarii 4 hours ago
        People are upvoting this because Tao is a celebrity.
        • pavel_lishin 3 hours ago
          I'm upvoting this because it's interesting. I don't have to fully understand something to find it interesting.
          • foobarqux 3 hours ago
            In what way is it interesting compared to the myriad of other posts on this topic that has content you can understand?
            • BigTTYGothGF 1 hour ago
              I read thru it and most of it is accessible to an undergraduate. As long as you remember what Sym{1,2,3} are (clearly explained in the text), and how a resultant works (many undergraduate textbooks will show you), how SL2 works (reasonably common undergraduate topic), and can figure out the bit about the dual space being the same as those differential operators, everything else is just basic (high school) algebra.
            • pavel_lishin 3 hours ago
              It's interesting because I like math, and typically posts like this generate a lot of interesting comments. Plus, in general, I'm wildly disinterested in the AI discourse that eats up 50-75% of the front page, so frankly anything that's slightly more interesting than that gets an upvote from me.
              • foobarqux 3 hours ago
                You seem to be saying that you would upvote an empty article (or a gibberish article) with the title "Jacobian Conjecture Counterexample", is that right?
                • pavel_lishin 1 hour ago
                  After that kind of a stretch, you're ready for any kind of exercise.
                • godwinson__4-8 2 hours ago
                  Are you always this subtle?
        • hyperhello 4 hours ago
          He’s famous, but I don’t believe he is a celebrity, as he is not famous for his persona.
          • Jtarii 3 hours ago
            I just mean, anything Tao writes that is related to AI will get on the front page, because Tao represents the authoritative voice of reason using AI tools. And this website is primarily for AI news.
            • bcraven 18 minutes ago
              >And this website is primarily for AI news.

              'twas not always thus ):

            • done_lurking 2 hours ago
              [dead]
          • alpinisme 3 hours ago
            He’s a hacker news celebrity but not a global celebrity
  • aayushdutt 2 hours ago
    After reading a quarter of the article I started wondering, is this what non coders feel when vibe coding software?
  • hyperhello 4 hours ago
    Okay. So what does this overturn, intuitively? Can we no longer assume that functions are differentiable at certain points, or something?
    • kingstnap 32 minutes ago
      I'm not a mathematian but I know enough linear algebra and vector calculus to understand the conjecture. This is my interpretation:

      Firstly, the determinant of the Jacobian is measuring if at any point the function is crushing space / flattening out.

      If the Jacobian is a nonzero constant everywhere this means that nowhere does the the function flatten out. A small change in X along any line will always produce a non zero change in Y. Not flattening out means that locally you can invert it.

      What was conjectured is that this local invertibability property everywhere would mean global invertibility.

      Turns out to not be the case.

      For a simple case, the falsified conjecture is trivially true in 1D.

      Specifically consider f(x) = x^2

      This function happens to flatten out right at x=0. At that x coodrinate the function flattens out and folds over on itself. This fold means you can't invert x^2. It's also not locally invertible around x=0.

      If a function f(x) has constant derivative evewhere then it would flatten out nowhere and it would be invertible everwhere. It would also be globally invertible.

      The Jacobian conjecture was stating that the extension of this property holds in higher dimensions. That if the function had no fold in space then it would be invertible globally.

      The counterexample shows that you can create a simple function in 3 variables, where the function demonstratably is invertible evewhere, but is not injective globally (they specifically show 3 points that map to the same output).

      What's interesting is this is like if someone showed you a parabola where somehow you got back to the same y coordinate without a kink bending over back to itself.

    • impendia 58 minutes ago
      For the Jacobian determinant to be constant is a massive coincidence, in general it is some complicated and messy polynomial. The conjecture was that this coincidence couldn't happen, except for simple special cases.

      So Alpoge and Fable found an example of a function that was believed to be too strange to exist.

    • mswphd 2 hours ago
      it doesn't overturn much. For example, here is a post from 2004

      https://www.math.columbia.edu/~woit/wordpress/?p=105

      it is about a purported (though incorrect) positive proof of the Jacobian conjecture in 2 dimemnsions. It is true in 1 dimension. The Fable proof is that it is false in >= 3 dimensions. 2 dimensions is still open.

      Anyway, in that post it says

      > It now seems that a proof has been found by Carolyn Dean of the University of Michigan, for the case of polynomials in two complex variables *(for more variables, many people believe it is not even true)*

      so the resolution of this is a "surprise" in that it is a very long open with many failed proof attempts. But the direction it resolved was not surprising.

    • monster_truck 2 hours ago
      Not much.

      But it does give credible plausibility to the concept that we might be mistaken about the exact boundaries of hardness for adjacent (but not equivalent) polynomial systems. Most (all?) of which have also stood up to a whole lot of undeniably sharp people poking at them for about as long.

    • sfpotter 3 hours ago
      No. This is about polynomials. The assumption that the Jacobian is nowhere zero is what is doing so much of the work. This means the Jacobian must in fact be constant. But obviously there are many mappings whose Jacobians are not constant.
    • jibal 33 minutes ago
      It overturns the Jacobian conjecture (i.e., speculation) for dim >= 3, which we now know was an overgeneralization. Tao characterizes it as "can be viewed as an assertion that local invertibility implies global invertibility". It was already widely suspected to be false. Assuming that it was true was never warranted, so this really doesn't change anything. The significance is that an AI was able to find a relatively simple counterexample. Its "chain of thought" would be very interesting to see.
  • jmward01 2 hours ago
    Finding a different way of thinking about a problem often leads to a breakthrough. This is what an ecosystem in nature shows us, that diversity matters in finding hard solutions. I think the great thing here is we are getting a chance to find whole new ways of thinking about problems that were hard. I suspect many old problems will fall because of it and, hopefully, some really new interesting ones will replace them.
    • gerdesj 1 hour ago
      "problems that were hard"

      They are still hard problems - As we say in the UK: "one swallow does not a summer make".

      As you well know: birds are not renowned for their arithmetic skills, nor eating encourages the weather!

  • zzzeek 3 hours ago
    reading through this I eventually realized a situation similar to my experience of it is what my dog sees if I attempt to explain Python programming to him.
    • richard_chase 43 minutes ago
      The difference is your dog will never understand the Python code but you could probably understand this post in a matter of days or weeks if you really wanted to. Can we all please stop acting like this Terry guy is so special?
      • bugufu8f83 0 minutes ago
        I certainly do not think that the average HN reader "could probably understand this post in a matter of days or weeks". I think the level of background information you need is something like an undergraduate degree in mathematics and at many universities that's probably not enough either.
      • tclancy 31 minutes ago
        Goats though, they get it. Bang your head against a monitor until things start working.
    • tgrowazay 2 hours ago
      Some people downvoting you, but I think it is a valuable illustration of IQ gap.

      And chances are that humanity at large will be soon trying to follow ai inventions and discoveries not unlike your dog follows your Python code.

      • left-struck 40 minutes ago
        I really don’t think IQ has much to do with it. Understanding this stuff is like a skill you practice. Yes, granted, if you had a low IQ your chances of ever understanding it goes down, if you have a high IQ maybe you can gain the prerequisite understanding faster.

        A lot of maths is about both being able to wrap your head around hard problems and gaining the prerequisite knowledge to make it easier to do so.

  • drivebyhooting 3 hours ago
    Can we audit the CoT and work the AI did to generate such a remarkable cancellation?
    • castedo 2 hours ago
      I doubt Anthropic will share the details (or at least the full true details). The mystery of the magic makes for much better marketing.

      I think a reasonable assumption is that there is an interaction between an LLM, a https://en.wikipedia.org/wiki/Computer_algebra_system tool, a human prompting with deep math expertise, and lots of compute that explains hitting upon the remarkable cancellation.

      • tptacek 1 hour ago
        I think you can reasonably assume that frontier models are using SymPy or something like it any time interesting math gets into the picture, and the person driving Fable here is an accomplished mathematician, but I don't think we can reasonably assume either extensive prompting or brute-force compute in any sense other than what it normally takes Fable to, say, whip up a calculator app.
      • impendia 53 minutes ago
        I have no idea what actually happened behind the scenes, but the human prompter, Levent Alpöge, indeed has deep math expertise. Princeton PhD, Harvard postdoc, and some excellent research (prior to this) to his name.

        https://alpo.ge/

      • jasonfarnon 2 hours ago
        Not just an assumption, I saw the LLM saying it used sympy.
      • p-e-w 2 hours ago
        > a human prompting with deep math expertise

        The original tweet implied that the whole thing was done while the author was watching the World Cup final.

        I know it’s tempting to hope that a human did the “real” work here, but if some special insight was put into prompting, the author kept it to himself, and there is no reason why they would hide this since it would elevate their own status.

        • monster_truck 1 hour ago
          I don't think it is as much about 'real' work or a special insight as it is being willing to push back multiple times, or simply asking in a way that steers it towards actually 'giving enough of a fuck' to even bother. We tend to be ~blind to how differently we would ask about something we know compared to a novice, this is what makes some better teachers than others.

          Have encountered a similar flavor in programming, wrote it off until I saw someone point out how garbage in garbage out they tend to be. If you hand any frontier model dogshit and ask it to do something simply, the result is often not great.

          But! If you spend 20 minutes having it comb through and clean up with something like jscpd, then tell it to step through with a debugger, gather profiling traces, etc... very likely it will yield meaningful improvements or catch some corner cases. If it doesn't, anyone with experience is going to tell it to try something else, or that it isn't good enough, as opposed to accepting the first result.

          You can recreate this by disabling web search and asking a model about the conjecture and then giving it his post. I've tried a few and their initial responses range from "this is a meme I'm not even going to verify it" to vaguely insulting chains of thought, concerns about the need to be careful because you're clearly nuts or stupid, then falling back on remedial explanations. After a few nudges they all eventually work through it, accept it, and apologize.

          IMO its reasonable to imagine a situation where someone is having a beer or two watching The Big Game, asking an LLM to do something stupid for fun and landing somewhere like this on the magic jump to conclusions mat.

    • netvarun 1 hour ago
  • ChrisArchitect 4 hours ago
    Related:

    Claude Fable produced a counterexample to the Jacobian Conjecture

    https://news.ycombinator.com/item?id=48973869

    Human mathematicians are being outcounterexampled

    https://news.ycombinator.com/item?id=48983382

  • brcmthrowaway 3 hours ago
    [dead]
  • greenavocado 4 hours ago
    [flagged]
    • fhdkweig 4 hours ago
      Honest question. Does asking "make no mistakes" actually change the output? Does it make mistakes if you don't bother to ask for no mistakes? Is it just to make the human feel more secure?
      • minimaxir 4 hours ago
        It's a meme. Telling it to "make no mistakes" doesn't do anything because LLMs don't have an inherent concept of a mistake and they are already RLHFed to code correctly.

        However, if you tell it to not do particular behaviors explicitly—some of which would be considered mistakes—it will not do said behaviors and with enough checks and balances, you'll get output without "mistakes".

        One example of this from the OpenAI Unit Distance prompt: https://cdn.openai.com/pdf/04d1d1e4-bc75-476a-97cf-49055cd98...

        > Do not return merely because current approaches fail or agents report theorem-strength gaps. Continue launching new rounds, reopening blocked approaches only when there is a genuinely new mechanism, and searching for fresh formulations. Return only when a complete affirmative proof has been found and survives adversarial audit.

        > Do not return a reduction, partial result, isolated missing lemma, “best effort” summary, or explanation of why the problem is difficult.

        • wren6991 1 hour ago
          I like the explicit and imperative style of this prompt. Makes me feel like LLMs are just weird Turing machines and CoT is their tape.
        • dcrazy 2 hours ago
          There really was a time when “make no mistakes” was thought to increase response quality. Maybe it steered the content of the thought channel?
      • saganus 4 hours ago
        It's just a meme at this point.
      • jewel 4 hours ago
        I believe it's a reference to a joke meme that goes something like "Write Windows 12 from scratch. Make no mistakes." At least that's the first context I heard it in.
      • hyperhello 4 hours ago
        It will make mistakes if you tell it to, so I assume it will make no mistakes if you tell it not to.
        • none_to_remain 3 hours ago
          When this news came out I amused myself by asking Claude to prove that 0.999... != 1. First it did so for the hyperreals. To do it for the reals I had to tell it it was allowed to make mistakes, although it didn't end up interestingly wrong - just very fuzzy and vague.
          • raphlinus 1 hour ago
            Actually it's not true for the hyperreals either, though this is a common misconception. It's extremely easy for me to believe that an llm would produce a "proof" and that people would fall for it.
          • greenavocado 3 hours ago
            Fable, prove that for every positive integer n, repeatedly dividing by 2 if even or multiplying by 3 and adding 1 if odd will always eventually reduce the sequence to 1.
      • greenavocado 3 hours ago
        > Does asking "make no mistakes" actually change the output?

        Why Teams Add "Make No Mistakes" to AI Prompts (And Why It Never Works)

        https://jakemcmahon.github.io/medium-articles/make-no-mistak...

  • richard_chase 52 minutes ago
    Guys, this guy is so brilliant that his mathematical expressions are embedded as images on his Wordpress blog. Truly amazing. This guy should be everywhere and get nothing but praise.
    • lubujackson 37 minutes ago
      I am sure he did the minimum effort needed to communicate what he wanted to communicate.

      If you are offended by his math gifs and feel that the widely regarded best mathematician of our time should use embedded LaTex or something better, why not offer to upgrade his blog?

    • tclancy 30 minutes ago
      Why are you so upset about people oohing and aahing? These may not be the fireworks you like, but don't yuck their yum. We should do more praising of each other for doing work.