Discussion about this post

User's avatar
Sean Corfield's avatar

I just came back from Clojure/conj in DC. This year there were several talks about integrating LLMs into our developer workflows -- and the successes were far more about using them for exploratory design conversations than simple code generation.

I've been using GitHub Copilot (Business) with VS Code for a while and I'm only just starting to develop workflows involving than code generation -- and realizing the benefit of being able to ask Copilot questions within the editor instead of changing context to a browser and "searching" for information.

Expand full comment
Vladimir Bychkovsky's avatar

Google went on red alert when ChatGPT started to gain public interest in 2021/22 because of the threat to their core business, search. The “I wonder’s” you describe are that deeper/enhanced search that LMMs offer. In the early days of the internet, one had to know how to find things (and that was the edge), with the advent of Google search, it got easier, but you still had to try a few times to transform your question into a query. Now you can have a conversation with a chat bot and find answers. Moreover one question to chatbot can replace a lot of queries and reading/sifting through many docs. We are basically zeroing in on the key human capability: “wondering about interesting things” and asking “the right” questions.

The issue of reliability and confidence still needs to be solved. It took Google a lot of work to filter out garbage sites from their results, but in the worst case, you could see that the page was not credible. The chat interface obfuscates the sources and interpolates (aka hallucinates) between them, so we gain convenience at the cost correctness.

This trade off may actually be ok, because we can still look for original sources etc and “I wonder”s are now a lot faster. As long as we don’t get too lazy. ( I am secretly waiting for an article to come out where an arrogant CEO would make a bad business decision based on a conversation with a chat bot! )

Expand full comment
6 more comments...

No posts