https://twitter.com/SilvermanJacob/status/1627418156150177792
2 Likes
Wtf
Almost convinced me 2=1
This is the best example I’ve seen of how these things are just fancy auto-complete with no actual understanding of what their saying.
I know there’s this idea that intelligence could still somehow emerge from this system. But I’m skeptical. At some point you need an understanding of what the actual words mean.
My biggest fear is someone hooks these things up to the ability to take actual action via hitting any URL it wants. It could post sensitive data. It could run searches that raise red flags. A lot of other stuff I imagine.
2 Likes
Sounds like corporate VPs might be the ones that get AI’ed out of their jobs.
3 Likes
Reminds me of how almost everyone in the poker world knows all the lingo but only like 5-10% of players actually know how and when to apply it. The majority are just regurgitating the words they have heard with no understating of the concepts. And that’s how things like the triple range merge are born.
3 Likes
Haven’t used or looked at chatgpt until today. I wasn’t too surprised it could solve for fizzbuzz, but it can solve fucking leetcode copy pastes, even hards.
“Explain the P=NP problem to me like I am a 5 year old.” was different when I put in 10 year old. Also worked when I asked for it in Latvian, interestingly slower though.
The scariest is “Create a react JS component in typescript that uses material ui component library. This component should be a form with an input box and a submit button. When the user hits submit, the text in the input box is displayed in a typography component below the form. When a user hovers over that component, it should turn bold.” which is ~50 lines of code and it got 99% right. This is… much more powerful and better than I expected. Its pretty nuts.
I did finally stump it, sorta, with “What’s the funniest joke you heard yesterday?” but I would suspect it struggles with “you” as a target in general so its not really fair.
How concerned should future software developers be? Can you give it a line of buggy code and ask it to squash the bugs?
Junior devs might be in trouble. The more senior you are the less time you spend actually coding.
As far as I know ChatGPT can’t sweet talk our stakeholders into accepting the solution that’s 95% of what they want, but 100x simpler to code. Shit like that is a big chunk of my job.
But then again maybe it could also help junior devs a lot to crank out code.
I’m not concerned about it taking people’s jobs at least not yet. What I do see is people using it today to automate some of the lower level details of coding, making components like the above, not having to read documentation on some things, automating regular expression building stuff like that.
It can identify code and find and fix bugs, at least simple ones. That’s not really surprising and won’t help programmers a lot. I don’t see it in any way being able to do a “ticket” i.e. implement a new feature in a codebase, there’s just too much context there I think. But its really really impressive, much more than I would have guessed.
Education (testing, essays) and hiring are going to be heavily impacted, and most likely strongly for the worst. I need to think about it because this really does change a lot.
https://chat.openai.com/chat if you haven’t tried it yet
I played around with it for coding quite a bit now, and it’s pretty good with guidance. E.g. if you have boiler plate code, you can show it by example what has been done for one class, and then tell it to do it for another one. Also transforming code from one language to another works well. In all cases you have to check the results though; it does make mistakes; sometimes hefty ones!
Nevertheless, I think it will be a huge productivity extender for software developers once properly integrated with IDEs and specifically trained for coding. That might or might not cost jobs, because software becomes ever more pervasive at the same time.
The only real trouble I see if it would manage to go from Powerpoint to Code reliably, but I don’t see that coming, and I think you will still need people around that know what’s going on. Unless of course it moves one to become a general AI.
The scary thing to me is that coding is a side hustle for ChatGPT, OpenAI have now hired a bunch of people to work on a purpose-built coding bot. I think we’re going to see very rapid improvement in it.
“write CSS to center something vertically on the page”
[bot melts down, data center on fire]
This is easy now for you kids and your fancy CSS3. Back in my day we had to make this work in IE6.
Pshhh - in my day I had to build a javascript-intensive app that worked on IE 4 and Netscape.
As far as I know it’s still running. Vanilla JS ftw. Web Result\View(tm) Logon
Banged on this for an hour or two and my assessment has gone down a bit. I asked it to do the following thing:
In typescript:
interface Rect {
width: number;
height: number;
x: number;
y: number;
}
Write a function that has 1 parameter which is an array of interface Rect.
This array represents a 12 column grid.
The Rect objects represent a rectangle in this grid, and they cannot overlap.
The function should return, in an array, the x and y closest to the upper left corner of the grid where a rectangle with a width of 4 rows and height of 2 columns can fit without overlapping another object or going beyond the 12th column.
and tweaked it in various ways it keeps pooping out some ugly stuff that may or may not work. By that I mean many nested loops when it should at maximum take 2 if not 1. Every tweak resulted in major differences. We’ll see I guess but this wasn’t as alarming as earlier thats for sure.