In late 2021, OpenAI faced a supply problem.
The artificial intelligence lab had exhausted every reservoir of reputable English-language text on the internet as it developed its latest A.I. system. It needed more data to train the next version of its technology — lots more.
So OpenAI researchers created a speech recognition tool called Whisper. It could transcribe the audio from YouTube videos, yielding new conversational text that would make an A.I. system smarter.
Some OpenAI employees discussed how such a move might go against YouTube’s rules, three people with knowledge of the conversations said. YouTube, which is owned by Google, prohibits use of its videos for applications that are “independent” of the video platform.
Ultimately, an OpenAI team transcribed more than one million hours of YouTube videos, the people said. The team included Greg Brockman, OpenAI’s president, who personally helped collect the videos, two of the people said. The texts were then fed into a system called GPT-4, which was widely considered one of the world’s most powerful A.I. models and was the basis of the latest version of the ChatGPT chatbot.
The race to lead A.I. has become a desperate hunt for the digital data needed to advance the technology. To obtain that data, tech companies including OpenAI, Google and Meta have cut corners, ignored corporate policies and debated bending the law, according to an examination by The New York Times.
At Meta, which owns Facebook and Instagram, managers, lawyers and engineers last year discussed buying the publishing house Simon & Schuster to procure long works, according to recordings of internal meetings obtained by The Times. They also conferred on gathering copyrighted data from across the internet, even if that meant facing lawsuits. Negotiating licenses with publishers, artists, musicians and the news industry would take too long, they said.
Before 2020, most A.I. models used relatively little training data.
Mr. Kaplan’s paper, released in 2020, led to a new era defined by GPT-3, a large language model, where researchers began including more data in their models …
… much, much more data.
How Google Can Use Your Data
Here are the changes Google made to its privacy policy last year for its free consumer apps.
#g-ai-google-policy-box{
padding:20px 0;
}
#g-ai-google-policy-box .g-cstyle0{
text-decoration: line-through;
font-style:normal;
background-color:#faa;
padding:0 3px;
}
#g-ai-google-policy-box .g-cstyle1{
background-color:#6ece62;
padding:0 3px;
text-shadow:0 0 2px rgba(0, 0, 0, .2)
}
#g-ai-google-policy-box header#interactive-header{
max-width:600px;
margin:0 auto;
}
#g-ai-google-policy-box footer#interactive-footer{
max-width:600px;
margin:0 auto;
}
#g-ai-google-policy-box ,
#g-ai-google-policy-box .g-artboard {
margin:0 auto;
}
#g-ai-google-policy-box p {
margin:0;
}
#g-ai-google-policy-box .g-aiAbs {
position:absolute;
}
#g-ai-google-policy-box .g-aiImg {
position:absolute;
top:0;
display:block;
width:100% !important;
}
#g-ai-google-policy-box .g-aiSymbol {
position: absolute;
box-sizing: border-box;
}
#g-ai-google-policy-box .g-aiPointText p { white-space: nowrap; }
#g-ai-google-policy-Artboard_1 {
position:relative;
overflow:hidden;
}
#g-ai-google-policy-Artboard_1 p {
font-family:nyt-franklin,arial,helvetica,sans-serif;
font-weight:300;
line-height:26px;
opacity:1;
letter-spacing:0em;
font-size:16px;
text-align:left;
color:rgb(0,0,0);
text-transform:none;
padding-bottom:0;
padding-top:0;
mix-blend-mode:normal;
font-style:normal;
height:auto;
position:static;
}
#g-ai-google-policy-Artboard_1 .g-cstyle0 {
font-style:italic;
}
#g-ai-google-policy-Artboard_1 .g-cstyle1 {
font-weight:600;
}
#g-ai-google-policy-Artboard_2 {
position:relative;
overflow:hidden;
}
#g-ai-google-policy-Artboard_2 p {
font-family:nyt-franklin,arial,helvetica,sans-serif;
font-weight:300;
line-height:26px;
opacity:1;
letter-spacing:0em;
font-size:16px;
text-align:left;
color:rgb(0,0,0);
text-transform:none;
padding-bottom:0;
padding-top:0;
mix-blend-mode:normal;
font-style:normal;
height:auto;
position:static;
}
#g-ai-google-policy-Artboard_2 .g-cstyle0 {
font-style:italic;
}
#g-ai-google-policy-Artboard_2 .g-cstyle1 {
font-weight:600;
}
Google uses information to improve our services and to develop new products, features and technologies that benefit our users and the public. For example, we use publicly available information to help train Google’s language AI models and build products and features like Google Translate, Bard, and Cloud AI capabilities.
Google uses information to improve our services and to develop new products, features and technologies that benefit our users and the public. For example, we use publicly available information to help train Google’s language AI models and build products and features like Google Translate, Bard, and Cloud AI capabilities.