- Easy Cloud AI
- Posts
- ‘Model collapse’: Scientists warn against letting AI eat its own tail
‘Model collapse’: Scientists warn against letting AI eat its own tail
Ray Choi
July 31, 2024
Welcome, AI enthusiasts.
|
Bible Verses of the Day
21 For to this you have been called, because Christ also suffered for you, leaving you an example, so that you might follow in his steps. 22 He committed no sin, neither was deceit found in his mouth. 23 When he was reviled, he did not revile in return; when he suffered, he did not threaten, but continued entrusting himself to him who judges justly. [1 Peter 2:21-23 ESV]
What's in this week's issue?
🦎 ‘Model collapse’: Scientists warn against letting AI eat its own tail
🔎 With Google in its sights, OpenAI unveils SearchGPT
⛅️ Easy Cloud News
📰 AI News
🧰 AI Tools
Generated by Midjourney
In a paper published in Nature, British and Canadian researchers led by Ilia Shumailov at Oxford show that today’s machine learning models are fundamentally vulnerable to a syndrome they call “model collapse.” As they write in the paper’s introduction:
We discover that indiscriminately learning from data produced by other models causes “model collapse” — a degenerative process whereby, over time, models forget the true underlying data distribution …
AI models are pattern-matching systems at heart: They learn patterns in their training data, then match prompts to those patterns, filling in the most likely next dots on the line.
Whether you ask, “What’s a good snickerdoodle recipe?” or “List the U.S. presidents in order of age at inauguration,” the model is basically just returning the most likely continuation of that series of words.
Generated by Midjourney
OpenAI may have designs to get into the search game — challenging not only upstarts like Perplexity, but Google and Bing, too.
The company on Thursday unveiled SearchGPT, a search feature designed to give “timely answers” to questions, drawing from web sources.
UI-wise, SearchGPT isn’t too far off from OpenAI’s chatbot platform ChatGPT. You type in a query, and SearchGPT serves up information and photos from the web along with links to relevant sources, at which point you can ask follow-up questions or explore additional, related searches in a sidebar.
Easy Cloud News
Listen or read the following transcript as Richard Belcher emphasizes the themes of encouragement and urgency for God’s people to prioritize their spiritual commitments and engage in rebuilding the temple, reflecting a broader call for spiritual renewal and faithfulness.
The following unedited transcript is provided by Beluga AI.
AI News
🇰🇷 Nvidia supplier SK Hynix to build $6.8 billion chip plant in South Korea (link)
⭕️ Level AI applies algorithms to contact center pain points (link)
🤖 Former Tesla humanoid head launches a robotics startup (link)
⛈️ Google creates AI weather simulator that measures climate change (link)
💸 Cohere raises $500M to beat back generative AI rivals (link)
AI Tools
This newsletter is powered by Beehiiv