AHEAD of OpenAI CEO Sam Altman’s four days in exile, several staff researchers wrote a letter to the board of directors warning of a powerful artificial intelligence discovery that they said could threaten humanity, two people familiar with the matter told Reuters.
The previously unreported letter and AI algorithm were key developments before the board's ouster of Altman, the poster child of generative AI, the two sources said. Prior to his triumphant return to OpenAI, more than 700 employees had threatened to quit and join backer Microsoft in solidarity with their fired leader.
The sources cited the letter as one factor among a longer list of grievances by the board leading to Altman's firing, among which were concerns over commercializing advances before understanding the consequences. Reuters was unable to review a copy of the letter. The staff who wrote the letter did not respond to requests for comment.
After being contacted by Reuters, OpenAI, which declined to comment, acknowledged in an internal message to staffers a project called Q* and a letter to the board before the weekend's events, one of the people said. An OpenAI spokesperson said that the message, sent by long-time executive Mira Murati, alerted staff to certain media stories without commenting on their accuracy.
Some at OpenAI believe Q* (pronounced Q-Star) could be a breakthrough in the startup's search for what's known as artificial general intelligence (AGI), one of the people told Reuters. OpenAI defines AGI as autonomous systems that surpass humans in most economically valuable tasks.
Given vast computing resources, the new model was able to solve certain mathematical problems, the person said on condition of anonymity because the individual was not authorized to speak on behalf of the company. Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said.
Reuters could not independently verify the capabilities of Q* claimed by the researchers.
'VEIL OF IGNORANCE'
Researchers consider math to be a frontier of generative AI development. Currently, generative AI is good at writing and language translation by statistically predicting the next word, and answers to the same question can vary widely. But conquering the ability to do math — where there is only one right answer — implies AI would have greater reasoning capabilities resembling human intelligence. This could be applied to novel scientific research, for instance, AI researchers believe.
Unlike a calculator that can solve a limited number of operations, AGI can generalize, learn and comprehend.
In their letter to the board, researchers flagged AI’s prowess and potential danger, the sources said without specifying the exact safety concerns noted in the letter. There has long been discussion among computer scientists about the danger posed by highly intelligent machines, for instance if they might decide that the destruction of humanity was in their interest.
Researchers have also flagged work by an "AI scientist" team, the existence of which multiple sources confirmed. The group, formed by combining earlier "Code Gen" and "Math Gen" teams, was exploring how to optimize existing AI models to improve their reasoning and eventually perform scientific work, one of the people said.
Altman led efforts to make ChatGPT one of the fastest growing software applications in history and drew investment - and computing resources - necessary from Microsoft to get closer to AGI.
In addition to announcing a slew of new tools in a demonstration this month, Altman last week teased at a summit of world leaders in San Francisco that he believed major advances were in sight.
"Four times now in the history of OpenAI, the most recent time was just in the last couple weeks, I've gotten to be in the room, when we sort of push the veil of ignorance back and the frontier of discovery forward, and getting to do that is the professional honor of a lifetime," he said at the Asia-Pacific Economic Cooperation summit.
A day later, the board fired Altman.
Reuters
Sun Nov 26 2023
Sam Altman led efforts to make ChatGPT one of the fastest growing software applications in history and drew investment - and computing resources - necessary from Microsoft to get closer to AGI. - REUTERS/Filepic
PRK Kuala Kubu Baharu: Semua pihak dinasihat elak provokasi, 3R - Saifuddin Nasution
Semua pihak diingatkan agar tidak menimbulkan sebarang unsur provokasi termasuk memainkan isu 3R sepanjang PKR Kuala Kubu Baharu.
AWANI Ringkas: DAP sukar raih undi Melayu
Ikuti rangkuman berita utama yang menjadi tumpuan sepanjang hari di Astro AWANI menerusi AWANI Ringkas.
PRK Kuala Kubu Baharu: Semua pihak diingat tidak sentuh 3R - Fahmi
Semua pihak diingatkan untuk berhati-hati dan tidak memainkan isu kaum, agama dan institusi raja (3R), terutama di platform media sosial, sepanjang tempoh berkempen PRK KKB.
PRK Kuala Kubu Baharu: 'Punca DAP pertaruh calon Cina'
Sukar untuk meraih undi Melayu didakwa menjadi punca DAP mengekalkan strategi dengan mempertandingkan calon berbangsa Cina pada Pilihan Raya Kecil (PRK) Kuala Kubu Baharu.
Pemandu peribadi ditahan belasah individu hingga pengsan
Seorang lelaki dibelasah sehingga tidak sedarkan diri dalam satu kejadian di tepi Jalan Memanda 9, Jalan Ampang, Ampang Jaya pada Jumaat.
Polis cari tiga individu simbah cat merah di restoran nasi kandar
Polis sedang mengesan tiga individu yang terlibat perbuatan khianat dengan melemparkan cat merah di sebuah restoran nasi kandar di Taman Machang Bubok Khamis lalu.
SPRM lancar bilik gerakan 24 jam
SPRM melancarkan bilik gerakan bagi membolehkan orang ramai menyalurkan maklumat serta aduan berkaitan perbuatan rasuah dan salah guna kuasa pada PRK DUN Kuala Kubu Baharu.
Tiada tepung mengandungi benzoil peroksida melebihi kadar
Tiada mana-mana jenama tepung di pasaran tempatan mengandungi Benzoil Peroksida melebihi paras yang dibenarkan.
Perintah notis berkaitan anak kepada individu disyaki
Dua anak bekas Perdana Menteri, Tun Dr Mahathir Mohamad menolak dakwaan mereka dalam siasatan SPRM.
Empat maut kenderaan bertembung
Empat individu maut dalam satu kemalangan melibatkan dua kenderaan pacuan empat roda di Kilometer 78, Jalan Kota Bharu- Gua Musang di Kuala Krai.
Apple dalam perbincangan guna teknologi OpenAI dalam iOS 18 - Laporan
iOS 18 akan membawakan perubahan paling besar untuk sistem operasi iPhone tahun ini dan integrasi sistem AI akan akhirnya didedahkan.
Adobe Premiere Pro akan terima ciri jana video dengan AI
Adobe telah membangunkan model bahasa raya Firefly Video Model. Ia adalah sebahagian kepada Firefly Image, Vector, Design, and Text Effects Models.
ChatGPT kini boleh sunting, ubah suai imej DALL.E
Menariknya ciri ini boleh digunakan di web, peranti iOS dan juga Android. Cara menggunakannya juga mudah, pertama masukkan prom u
Kini boleh guna ChatGPT tanpa akaun berdaftar
OpenAI membuka akses ChatGPT kepada semua, sekali gus membolehkan orang ramai menggunakannya tanpa perlukan sebarang akaun.
Microsoft, OpenAI dilapor rancang projek pusat data AS$100 bilion
Projek berkenaan juga dijangka menambah sebuah adikomputer AI yang dinamakan Stargate seawal 2028.
OpenAI hadir dengan Voice Engine, penjana suara sintetik daripada sampel 15 saat
Pengguna boleh menggunakan input berasaskan teks untuk menjana audio daripada suara berkenaan.
Ini filem-filem pendek terawal dihasilkan melalui OpenAI Sora
Walaupun teknologi AI generatif ada banyak isu seperti melanggar hak cipta, ramai artis mula menghargai teknologi ini.
Video AI: Keupayaan Sora dipertonton kepada studio Hollywood
Pihak OpenAI buat masa ini tidak menyatakan apakah sumber latihan untuk Sora, di samping bilakah Sora akan ditawarkan kepada umum.
Model baharu GPT dilancar tahun ini - CEO OpenAI
Sam Altman berkata model baharu itu nanti akan menawarkan sesuatu yang jauh lebih baik berbanding GPT-4.
Elon Musk bakal tawarkan kod sumber untuk chatbot 'Grok' minggu ini
Grok merupakan chatbot sebaris dengan ChatGPT yang membolehkan pengguna berinteraksi dalam mendapatkan maklumat berkaitan.