Math is such an interesting field. People can work for decades and not make progress, then discover something in a moment of clarity from some seemingly unrelated problem. As a programmer, I don't have that type of patience.
groby_b 1 days ago [-]
Get yourself a slower compiler ;)
But all kidding aside, you likely will have those moments. Not because you had patience, but because over you career you collected enough knowledge bits in your brain that they'll at some point click together in extremely odd shapes.
Like with maths, if you choose to follow up, this is either a moment of clarity, or the moment you enter crankdom.
godelski 24 hours ago [-]
Honestly, this happens in a lot of fields, including programming. I often wonder why we spend so much time trying to justify certain research avenues over others and don't let people just research what they find is interesting. I hear you, we should be efficient and not waste money. But is there actually good evidence that we have strong predictive powers here? There's at least strong evidence that dark horses are quite common in the innovation space and exceptionally common in major breakthroughs. So even if we want to primarily focus on funding promising directions there is still good evidence that optimal funding requires funding unpopular ideas.
Which if we think about a lot of this, it should make sense anyways. Just by thinking about optimization theory. It is often quite good to add noise so that your optimization function can escape local minima. We can only travel directly to the global optima if we know exactly where it is. But should we not expect that expert predictive power is much better at pointing to local optima rather than global? (global very likely doesn't exist but that doesn't mean there aren't better optima).
There's also many famous scientists that didn't "spend much time working." I add quotes, because if you're a researcher you'd naturally understand there's no real thing as "not working." There is only active work and inactive work. You're likely consumed by the topics and problems you're trying to solve. So doing things like going on walks, playing your favorite sport, or whatever ends up being beneficial as you can relax and shift between focused and creative modes. But that doesn't happen as much if your boss thinks "working" is staring at the chalkboard. Sometimes it is best to go sit outside and daydream, while other times it is best to hammer your head against that metaphorical chalkboard.
> I don't have that type of patience.
As for this, patience is a skill. Delayed rewards. Long term rewards are often noisier and more difficult to attribute to their appropriate causes. Even if the long term rewards are substantially greater than the short term, and the timeframe isn't too large, most people prefer the short term. Not just because reward, but because interpretability. As an example, just think about education in of itself. Lots of effort but also lots of reward. Even though the process is very noisy and it is unclear which aspects of education contributed the most to success, it is very clear that there's a strong connection between education and success (does not mean there aren't other pathways to success nor that you are guaranteed to be successful by being educated. It can be easy to conflate these things).
eru 23 hours ago [-]
> I often wonder why we spend so much time trying to justify certain research avenues over others and don't let people just research what they find is interesting.
Oh, that's just an artifact of using tax payer money to finance research. If you stopped that, you didn't need to mandate any such justifications.
(Though individual funders could of course try to demand any justification they feel is appropriate for their funds. Just like today.)
godelski 7 hours ago [-]
> Oh, that's just an artifact of using tax payer money to finance research.
This is true even if you're at a large company. But you're right that it is not true for most of the old scientists who predominately came from wealthy families. But I don't think we should "stop that" and rather I'm arguing that we should "modify it to reflect reality." Of course, it gets political, but governments (and its people) are highly incentivized to make long term improvements and work at scales and problems that aren't as appropriate for individuals or even companies (companies must work on much smaller timescales).
We really just need to stop getting in our own way. But that requires admitting we are dumb. Even if we're smart that doesn't mean we're not also dumb.
Then again, Musk has enough money he could develop over a dozen CERNs himself and fully fund them indefinitely, a feat so far done only by the agglomerated efforts of a large organization of countries (despite it being a drop in the bucket for their budgets).
I've never understood billionaires and mega billionaires though. Because I'd be setting up as many mega projects I could and give them indefinitely funding because you can't throw your money away faster than it grows. Well... I guess I understand MacKenzie Scott...
TeMPOraL 23 hours ago [-]
> I often wonder why we spend so much time trying to justify certain research avenues over others and don't let people just research what they find is interesting.
I honestly feel this is mostly because of a (possibly well-justified) fear that, were we to not do that, almost all the money would quickly get captured by grifters whose ideas are fake and of no research value, but who were best at convincing they're worth funding. We can't read peoples' hearts, so we need to force out some output we can discriminate on.
godelski 5 hours ago [-]
I believe you are correct, but at the same time, are we not already giving a lot of money to grifters?
For most research funding, I think the incentives are misaligned for the type of grifters we're trying to prevent, i.e. people just pocketing the money. The money is too low and the barriers are too high. The grifting that does happen is more about metric hacking and is about the status one achieves in academia. Yeah, there's high profile people that make good money on this, but at the same time many in the respective fields are not shocked to find that their papers were faked. There were usually existing accusations. But the structures in place are not well aligned to oust or investigate them. The publish or perish paradigm gives little time for replication experiments and you should come with strong evidence before making accusations. We're also getting better at this, but more awareness and more discovery has not led to these people losing their positions our status. (We even see universities protect them at times) Take this recent plagiarism case[0]. Most authors have quite good citation records and metrics, but how does a work that's so egregious not cause other works to be investigated, it warrants suspicion. We have network graphs of researchers, with their collaborators, but why do we not build these graphs for abusers? Most of the time the abuse is purged behind closed doors and so it even makes it harder to build the networks.
CS is especially egregious for this. I lost a lot of respect for a bunch of my ML researcher peers when they promoted Rabbit. The demo was so egregiously faked and none of the claims made sense given the state of research. But we throw tons of money at these types of problems. We thrive on hype bubbles and don't purge the conmen. Hell, we often reward bad behavior. Like how that intern that got fired from Bytedance for manipulating code won Best Paper and NeurIPS[1]. The HumanEval paper is ridiculously naive (to think you can write "leetcode style problems" and that because you wrote them "by hand" that they won't be spoiled by training on GitHub. You can find identical code to most of the canonical solutions trivially!). There's tons of memes in ML around plagiarism and as best as I can tell all these authors are still doing just fine. How an egregious case doesn't result in a 1 year probation for a conference is beyond me. We suspend students for this academic misconduct but bury it for professors and grad students?
The incentives are all wrong and we need to take a serious look at ourselves. Because we are in fact protecting the grifters. It is just lucky that most people are uninterested in grifting in this domain, though as said, there isn't much incentive to (obviously changing with the prominence in ML).
I get a lot of value from YouTubers who simple follow a consistent methodology of endurance or break testing products or materials. Tear downs and documentation of internals, performance statistics, etc...
Channels like CNCKitchen or ProjectFarm are excellent citizen scientists for example.
empath75 1 days ago [-]
Something that may not be clear when reading this is the distinction between complex numbers and the ring of integers adjoined with i.
"Complex numbers" are of the form a+bi where a and b can be any real number -- 1, 5, pi, the square root of 2, -2.14, etc.
The ring of integers adjoined with i are numbers of the form a+bi where a and b are both integers (-1, 5, 34, etc).
You can also, in addition to using i, adjoin any real number to the integers and get a new field with numbers of the form a+bx where a and b are integers and x is any additional number you want to add-- frequently square roots like the square root of two.
This result shows undecidability of diophantine equations in all those fields of integers, but not complex numbers, for which it's easy to prove that there are _always_ solutions.
Sniffnoy 1 days ago [-]
Note that Z[i] is called the "Gaussian integers" -- you don't have to keep repeating "the ring of integers with i adjoined"!
Also I should point out that in general Z[r] for some r (note obviously r doesn't have to be real!) will contain more than just a+br; it'd only be just a+br if r satisfies a monic quadratic over Z.
(I also have to nitpick and point out that these results apply to rings of integers -- actually more broadly -- but not to the fields. Yeah unfortunately mathematicians often abuse the language here, using "number field" to refer to the ring, and it's annoying. But Hilbert's 10th for Q remains open to my knowledge.)
Edit: Ugh I forgot this site doesn't allow bold
1 days ago [-]
dooglius 24 hours ago [-]
> Where is the cutoff
Is there a reason to believe there is a "cutoff"? As in, do we know that if the undecidability property holds for some ring A, then it holds for every subring of A?
eru 23 hours ago [-]
I guess it depends a bit on what you mean by subring?
If you go by the strict definition of subring, I'm not sure. But we probably also want to explore other constructions like quotient rings, where I know that we can say some things.
Eg calculating modulo some (given fixed) integer is a quotient ring on the integers.
dooglius 20 hours ago [-]
I mean it pretty loosely, I'm just trying to figure out what Mazur meant. The quote and reference to a cutoff seems to imply that solveability preserves some kind of structural partial order between Z and C, but it's not clear to me why one would expect that to be the case.
wslh 12 hours ago [-]
Could Matiyasevich's result be viewed in the same vein as Turing’s Halting Problem, but in an even more compact form regarding the limits of mathematics and logic? Diophantine equations are expressed in a simpler form than Turing machines, which makes the size and expressiveness of the problem particularly interesting for study.
isaacfrond 11 hours ago [-]
Matiyasevich just says: for every Turing machine a diophantine equation can be constructed such that the diophantine equation has integer solutions if and only if the Turing machine halts.
Rendered at 00:33:03 GMT+0000 (Coordinated Universal Time) with Vercel.
But all kidding aside, you likely will have those moments. Not because you had patience, but because over you career you collected enough knowledge bits in your brain that they'll at some point click together in extremely odd shapes.
Like with maths, if you choose to follow up, this is either a moment of clarity, or the moment you enter crankdom.
Which if we think about a lot of this, it should make sense anyways. Just by thinking about optimization theory. It is often quite good to add noise so that your optimization function can escape local minima. We can only travel directly to the global optima if we know exactly where it is. But should we not expect that expert predictive power is much better at pointing to local optima rather than global? (global very likely doesn't exist but that doesn't mean there aren't better optima).
There's also many famous scientists that didn't "spend much time working." I add quotes, because if you're a researcher you'd naturally understand there's no real thing as "not working." There is only active work and inactive work. You're likely consumed by the topics and problems you're trying to solve. So doing things like going on walks, playing your favorite sport, or whatever ends up being beneficial as you can relax and shift between focused and creative modes. But that doesn't happen as much if your boss thinks "working" is staring at the chalkboard. Sometimes it is best to go sit outside and daydream, while other times it is best to hammer your head against that metaphorical chalkboard.
As for this, patience is a skill. Delayed rewards. Long term rewards are often noisier and more difficult to attribute to their appropriate causes. Even if the long term rewards are substantially greater than the short term, and the timeframe isn't too large, most people prefer the short term. Not just because reward, but because interpretability. As an example, just think about education in of itself. Lots of effort but also lots of reward. Even though the process is very noisy and it is unclear which aspects of education contributed the most to success, it is very clear that there's a strong connection between education and success (does not mean there aren't other pathways to success nor that you are guaranteed to be successful by being educated. It can be easy to conflate these things).Oh, that's just an artifact of using tax payer money to finance research. If you stopped that, you didn't need to mandate any such justifications.
(Though individual funders could of course try to demand any justification they feel is appropriate for their funds. Just like today.)
We really just need to stop getting in our own way. But that requires admitting we are dumb. Even if we're smart that doesn't mean we're not also dumb.
Then again, Musk has enough money he could develop over a dozen CERNs himself and fully fund them indefinitely, a feat so far done only by the agglomerated efforts of a large organization of countries (despite it being a drop in the bucket for their budgets).
I've never understood billionaires and mega billionaires though. Because I'd be setting up as many mega projects I could and give them indefinitely funding because you can't throw your money away faster than it grows. Well... I guess I understand MacKenzie Scott...
I honestly feel this is mostly because of a (possibly well-justified) fear that, were we to not do that, almost all the money would quickly get captured by grifters whose ideas are fake and of no research value, but who were best at convincing they're worth funding. We can't read peoples' hearts, so we need to force out some output we can discriminate on.
For most research funding, I think the incentives are misaligned for the type of grifters we're trying to prevent, i.e. people just pocketing the money. The money is too low and the barriers are too high. The grifting that does happen is more about metric hacking and is about the status one achieves in academia. Yeah, there's high profile people that make good money on this, but at the same time many in the respective fields are not shocked to find that their papers were faked. There were usually existing accusations. But the structures in place are not well aligned to oust or investigate them. The publish or perish paradigm gives little time for replication experiments and you should come with strong evidence before making accusations. We're also getting better at this, but more awareness and more discovery has not led to these people losing their positions our status. (We even see universities protect them at times) Take this recent plagiarism case[0]. Most authors have quite good citation records and metrics, but how does a work that's so egregious not cause other works to be investigated, it warrants suspicion. We have network graphs of researchers, with their collaborators, but why do we not build these graphs for abusers? Most of the time the abuse is purged behind closed doors and so it even makes it harder to build the networks.
CS is especially egregious for this. I lost a lot of respect for a bunch of my ML researcher peers when they promoted Rabbit. The demo was so egregiously faked and none of the claims made sense given the state of research. But we throw tons of money at these types of problems. We thrive on hype bubbles and don't purge the conmen. Hell, we often reward bad behavior. Like how that intern that got fired from Bytedance for manipulating code won Best Paper and NeurIPS[1]. The HumanEval paper is ridiculously naive (to think you can write "leetcode style problems" and that because you wrote them "by hand" that they won't be spoiled by training on GitHub. You can find identical code to most of the canonical solutions trivially!). There's tons of memes in ML around plagiarism and as best as I can tell all these authors are still doing just fine. How an egregious case doesn't result in a 1 year probation for a conference is beyond me. We suspend students for this academic misconduct but bury it for professors and grad students?
The incentives are all wrong and we need to take a serious look at ourselves. Because we are in fact protecting the grifters. It is just lucky that most people are uninterested in grifting in this domain, though as said, there isn't much incentive to (obviously changing with the prominence in ML).
[0] https://openreview.net/forum?id=cIKQp84vqN
[1] https://www.wired.com/story/bytedance-intern-best-paper-neur...
Nowadays you need intercontinental collaboration between research labs.
And that's not _just_ because of the bureaucrats.
Analyzing data sets and producing good data are bottlenecks.
It's usually less fundamental and more related to recording and analyzing properties of the world though.
You can crunch numbers that CERN and MAST provide.
https://archive.stsci.edu/ https://opendata.cern.ch/
I've gotten into 3D printing, and load and temperature data of different filaments is always appreciated.
Mixing materials together, microscopic images, etc...
I get a lot of value from YouTubers who simple follow a consistent methodology of endurance or break testing products or materials. Tear downs and documentation of internals, performance statistics, etc...
Channels like CNCKitchen or ProjectFarm are excellent citizen scientists for example.
"Complex numbers" are of the form a+bi where a and b can be any real number -- 1, 5, pi, the square root of 2, -2.14, etc.
The ring of integers adjoined with i are numbers of the form a+bi where a and b are both integers (-1, 5, 34, etc).
You can also, in addition to using i, adjoin any real number to the integers and get a new field with numbers of the form a+bx where a and b are integers and x is any additional number you want to add-- frequently square roots like the square root of two.
This result shows undecidability of diophantine equations in all those fields of integers, but not complex numbers, for which it's easy to prove that there are _always_ solutions.
Also I should point out that in general Z[r] for some r (note obviously r doesn't have to be real!) will contain more than just a+br; it'd only be just a+br if r satisfies a monic quadratic over Z.
(I also have to nitpick and point out that these results apply to rings of integers -- actually more broadly -- but not to the fields. Yeah unfortunately mathematicians often abuse the language here, using "number field" to refer to the ring, and it's annoying. But Hilbert's 10th for Q remains open to my knowledge.)
Edit: Ugh I forgot this site doesn't allow bold
Is there a reason to believe there is a "cutoff"? As in, do we know that if the undecidability property holds for some ring A, then it holds for every subring of A?
If you go by the strict definition of subring, I'm not sure. But we probably also want to explore other constructions like quotient rings, where I know that we can say some things.
Eg calculating modulo some (given fixed) integer is a quotient ring on the integers.