What's new

SCMP: As ChatGPT unveils latest model [ChatGPT-4], Chinese AI developers worry about keeping up

Hamartia Antidote

ELITE MEMBER
Joined
Nov 17, 2013
Messages
35,188
Reaction score
30
Country
United States
Location
United States
  • Observers say China risks falling behind in ‘winner-takes-all’ tech race
OpenAI released its GPT-3 model in 2020, but it did not receive much attention until ChatGPT went viral late last year. Photo: Reuters

OpenAI released its GPT-3 model in 2020, but it did not receive much attention until ChatGPT went viral late last year. Photo: Reuters

OpenAI released a new version of ChatGPT on Wednesday that has left the older model in the dust and the Chinese AI community more worried than ever.
The new AI model, called GPT-4, surpassed the vast majority of humans on several difficult tests and tasks.

For example, it scored better than 90 per cent of human test takers on a simulated bar exam, compared with the previous GPT-3.5 version, which scored in the bottom 10 per cent.

GPT-4 also scored 710 points on the reading and writing section and 700 points on the mathematics section of the SAT, putting it in the 96th percentile among 1.7 million US students taking the university entrance exam.

“The super long acknowledgement list in the GPT-4 technical report seems to tell us that this is the achievement of an ‘army’ after several years of hard work with leaders that know how to dream,” said Zhao Junbo, a professor at Zhejiang University.

“[Chinese developers] may have significant gaps in engineering and hardware compared with OpenAI.”


On Thursday, Chinese tech giant Baidu plans to launch a new generation of its large language model Wenxin Yiyan, also known as Ernie Bot. Its unveiling in the shadow of the latest ChatGPT debut has added to the expectations for Baidu’s service to perform well.

Chinese industry insiders worry about a winner-takes-all race in artificial intelligence.
“From scale to the effect of large language models, Chinese companies are falling behind OpenAI. ChatGPT is taking the lead both in completeness of answers and reply speed,” said an anonymous AI company founder quoted by DI Frontline, a Chinese media platform focused on tech-related news.

“[Although] still limited in many ways, [GPT-4] passes many qualification benchmarks like the bar exam and AP Calculus,” said OpenAI president Greg Brockman on Twitter on Wednesday.

“ChatGPT is the newest generation of methods for humans to retrieve knowledge, after the invention of databases and search engines, and will give birth to a new tech giant,” said Che Wanxiang, a professor at Harbin Institute of Technology in northeastern China.

“How knowledge is represented inside a computer is one of the core issues of artificial intelligence,” Che told a forum in Beijing last Sunday.

He explained that databases were one of the first methods created for humans to interact with machines, which spawned companies such as Oracle and Microsoft.
Then, after the internet grew to hold all human knowledge, search engine companies like Google and Baidu were born, he said.

“Now it is the era of large language models. Knowledge is stored as parameters that humans don’t understand, but we can access them through natural language. It seems that OpenAI has a clear lead and has the potential to become the new champion.”

The US company released its GPT-3 model in 2020, but it did not receive much attention until ChatGPT went viral late last year.
Che said ChatGPT solved the problem of how to retrieve knowledge in an unprecedented way.

GPT-4 goes a step further in solving this problem. According to OpenAI, the new model has a strong ability to recognise pictures, and its text input limit has been increased to 25,000 words. It can also generate lyrics, creative text and make style changes.

GPT-4 scored 40 per cent higher than GPT-3.5 on a series of questions designed to trick it, according to OpenAI, which has yet to publish the training parameters for the AI model.

The new model also has better logical abilities than its predecessor, with the ability to explain memes, read comics, summarise scholarly papers and answer questions about them.

Researchers continue to find new tasks for the model, and the limitation seems to be the human imagination rather than the AI’s capabilities.

China has thrown its support behind AI development.
On February 24, Chen Jiachang, head of the department of new and high technology under the Ministry of Science and Technology, said the ministry would “continue to give strong support to artificial intelligence as a strategic emerging industry and a new growth engine”.

Market Hubs, an integrated marketing company in Hong Kong, announced on Wednesday the launch of its AI product Market Hubs Lite. It uses robots to write press releases, speeches, social media posts and text for customer service interactions and search engine optimisation.

Many companies have entered the competition to build the Chinese version of ChatGPT. The Beijing Academy of Artificial Intelligence has developed the world’s largest pre-trained language model, dubbed Wudao 2.0, and tech giant ByteDance is working on its DA-Transformer model.


 
Last edited:
. .
  • Observers say China risks falling behind in ‘winner-takes-all’ tech race
OpenAI released its GPT-3 model in 2020, but it did not receive much attention until ChatGPT went viral late last year. Photo: Reuters

OpenAI released its GPT-3 model in 2020, but it did not receive much attention until ChatGPT went viral late last year. Photo: Reuters

OpenAI released a new version of ChatGPT on Wednesday that has left the older model in the dust and the Chinese AI community more worried than ever.
The new AI model, called GPT-4, surpassed the vast majority of humans on several difficult tests and tasks.

For example, it scored better than 90 per cent of human test takers on a simulated bar exam, compared with the previous GPT-3.5 version, which scored in the bottom 10 per cent.

GPT-4 also scored 710 points on the reading and writing section and 700 points on the mathematics section of the SAT, putting it in the 96th percentile among 1.7 million US students taking the university entrance exam.

“The super long acknowledgement list in the GPT-4 technical report seems to tell us that this is the achievement of an ‘army’ after several years of hard work with leaders that know how to dream,” said Zhao Junbo, a professor at Zhejiang University.

“[Chinese developers] may have significant gaps in engineering and hardware compared with OpenAI.”


On Thursday, Chinese tech giant Baidu plans to launch a new generation of its large language model Wenxin Yiyan, also known as Ernie Bot. Its unveiling in the shadow of the latest ChatGPT debut has added to the expectations for Baidu’s service to perform well.

Chinese industry insiders worry about a winner-takes-all race in artificial intelligence.
“From scale to the effect of large language models, Chinese companies are falling behind OpenAI. ChatGPT is taking the lead both in completeness of answers and reply speed,” said an anonymous AI company founder quoted by DI Frontline, a Chinese media platform focused on tech-related news.

“[Although] still limited in many ways, [GPT-4] passes many qualification benchmarks like the bar exam and AP Calculus,” said OpenAI president Greg Brockman on Twitter on Wednesday.

“ChatGPT is the newest generation of methods for humans to retrieve knowledge, after the invention of databases and search engines, and will give birth to a new tech giant,” said Che Wanxiang, a professor at Harbin Institute of Technology in northeastern China.

“How knowledge is represented inside a computer is one of the core issues of artificial intelligence,” Che told a forum in Beijing last Sunday.

He explained that databases were one of the first methods created for humans to interact with machines, which spawned companies such as Oracle and Microsoft.
Then, after the internet grew to hold all human knowledge, search engine companies like Google and Baidu were born, he said.

“Now it is the era of large language models. Knowledge is stored as parameters that humans don’t understand, but we can access them through natural language. It seems that OpenAI has a clear lead and has the potential to become the new champion.”

The US company released its GPT-3 model in 2020, but it did not receive much attention until ChatGPT went viral late last year.
Che said ChatGPT solved the problem of how to retrieve knowledge in an unprecedented way.

GPT-4 goes a step further in solving this problem. According to OpenAI, the new model has a strong ability to recognise pictures, and its text input limit has been increased to 25,000 words. It can also generate lyrics, creative text and make style changes.

GPT-4 scored 40 per cent higher than GPT-3.5 on a series of questions designed to trick it, according to OpenAI, which has yet to publish the training parameters for the AI model.

The new model also has better logical abilities than its predecessor, with the ability to explain memes, read comics, summarise scholarly papers and answer questions about them.

Researchers continue to find new tasks for the model, and the limitation seems to be the human imagination rather than the AI’s capabilities.

China has thrown its support behind AI development.
On February 24, Chen Jiachang, head of the department of new and high technology under the Ministry of Science and Technology, said the ministry would “continue to give strong support to artificial intelligence as a strategic emerging industry and a new growth engine”.

Market Hubs, an integrated marketing company in Hong Kong, announced on Wednesday the launch of its AI product Market Hubs Lite. It uses robots to write press releases, speeches, social media posts and text for customer service interactions and search engine optimisation.

Many companies have entered the competition to build the Chinese version of ChatGPT. The Beijing Academy of Artificial Intelligence has developed the world’s largest pre-trained language model, dubbed Wudao 2.0, and tech giant ByteDance is working on its DA-Transformer model.

GPT-4 is by far the most advanced commercial AI I’ve seen to date. OpenAI has set themselves at the pinnacle of AI along with NVidia on the hardware side.
 
. . . .

SCMP: ChatGPT sparks investment frenzy and soul searching in China’s artificial intelligence drive

  • While China had declared AI strategically important as early as 2018, ChatGPT has shattered illusions about the country’s technological prowess
  • A censored internet, compounded by the lack of access to advanced chips, could hinder China’s ambitions to create a true equivalent to ChatGPT
China has been pouring billions of dollars into artificial intelligence development, but censorship and technological limitations may hinder the country’s drive to build a a true competitor to ChatGPT. Illustration: Lau Ka-kuen

China has been pouring billions of dollars into artificial intelligence development, but censorship and technological limitations may hinder the country’s drive to build a a true competitor to ChatGPT. Illustration: Lau Ka-kuen

When the world first witnessed the power of OpenAI’s conversational bot ChatGPT late last year, one social media post quickly went viral in China, attempting to explain why this artificial intelligence (AI) breakthrough did not happen in the country.

The most widely-shared answer, provided by an anonymous author, was that Chinese technology firms were just too short-sighted to bear the cost of long-term investment, choosing instead to rush towards technologies that can be quickly commercialised.

“When the kid next door publishes a revolutionary doctorate paper, don’t ask why that kid is so smart,” it said. “You also have a smart kid in your house, but instead of supporting his study, you asked him to make quick money while he was still able to perform manual labour.”


Many netizens find the metaphor apt in describing the root of China’s technological shortcomings. Despite strong policy and financial support by the state, as well as ample private investment, the country has been unable to beat the US to the punch in creating a cutting-edge AI chatbot like ChatGPT.

In 2018, President Xi Jinping conducted a special study session with the Politburo. It concluded that AI was strategically important, and could lead to a technological revolution and industrial changes with “profound impact on economic development, social progress, and the pattern of the international political economy”.

With the blessing of China’s top leadership, government and private funding poured into domestic AI start-ups.

In the ensuing years, the country saw the emergence of the “four little dragons” – Cloudwalk Technology, Megvii, SenseTime, and Yitu – all focused on the AI field of visual recognition.

Meanwhile, commercial products bearing the AI label have flooded the Chinese market. SenseTime, for instance, launched a robot designed solely for teaching kids how to play chess.

By 2021, Chinese firms claimed to have produced 21 large language models, up from just two in 2020, putting them on a par with the United States. A large language model, according to AI chip designer Nvidia, represents a deep-learning algorithm that can recognise, summarise, translate, predict and generate text and other content based on knowledge gained from massive data sets.

But the arrival of ChatGPT shattered the illusion that China and the US were competing neck and neck in AI.

Zhou Hongyi, founder of 360 Security Technology, says China’s AI development lags behind the level of OpenAI. Photo: Shutterstock

Zhou Hongyi, founder of 360 Security Technology, says China’s AI development lags behind the level of OpenAI. Photo: Shutterstock

China’s knowledge level in AI is two to three years behind OpenAI, the San Francisco-based start-up that created ChatGPT, said Zhou Hongyi, founder of cybersecurity firm 360 Security Technology and an industry veteran with close ties to Chinese authorities, at the China Development Forum last weekend.

That technological gap, however, has not deterred Chinese companies and entrepreneurs from touting their own plans to launch their own ChatGPT rivals in the country, where the chatbot is not officially available, because of the government’s attitude towards uncensored content.

In March, internet search giant Baidu launched Ernie Bot, becoming the first major tech company in China to launch its own GPT-like service. Wang Huiwen, co-founder of on-demand services giant Meituan, and Lee Kai-fu, former China head of Google, have both started new ventures to explore the business potential of generative AI.

But analysts caution that this gold rush could be short-lived owing to lack of technical expertise and experience, compounded by US export restrictions on AI chips, which would hinder the development of a true ChatGPT-equivalent in China.

Lee Kai-fu, former head of Google China, has launched a new venture looking into the business potential of ChatGPT-like technologies. Photo: Edmond So

Lee Kai-fu, former head of Google China, has launched a new venture looking into the business potential of ChatGPT-like technologies. Photo: Edmond So

The fanfare around ChatGPT only shows how much the market is craving for a new investment narrative, according to Bo Pei, an equity analyst at Tiger Securities. “After so many years of development, both the Western and Chinese internet industries are saturated and thirsting for a new direction.”

“It is questionable how soon ChatGPT-like tools will actually make an impact or produce meaningful revenue,” Bo said.

One big obstacle is China’s walled internet. With the Chinese government prohibiting the country’s more than 1 billion internet users from accessing uncensored content, the materials that researchers can use to train AI engines are more limited than in the West.

A random test conducted by the Post last month, for example, found that Baidu’s Ernie Bot was unable to answer questions related to topics deemed politically sensitive by Beijing. When asked if China was a democratic nation, the chatbot ducked the question, simply replying that it “hasn’t learned how to answer this question yet”.

Baidu CEO Robin Li Yanhong introduces the functions of Ernie Bot during a launch event in Beijing on March 16. Photo: AP Photo

Baidu CEO Robin Li Yanhong introduces the functions of Ernie Bot during a launch event in Beijing on March 16. Photo: AP Photo

“Censorship could certainly hinder China’s ability to develop a local equivalent to ChatGPT,” Dahlia Peterson, a research analyst at Georgetown University’s Centre for Security and Emerging Technology, said in February.

“Even if [Chinese] AI companies are able to access and utilise global data and research resources to train their AI models, it is unlikely Chinese authorities will allow them to use any material deemed as politically sensitive in their replies,” she added.

While censorship will not stop China from coming up with its own answers to ChatGPT, much in the same way that the country developed its own search engines after Google pulled out of the market, it could take two to three years for Chinese industry players to develop models that are at least 80 per cent as powerful as ChatGPT, according to research company Third Bridge.

And as China continues to fence off its internet, its gap with global AI leaders, such as the US, could widen. Within just four months after the public launch of ChatGPT in November, OpenAI released its next-generation language prediction model GPT-4, which has more sophisticated capabilities, including the ability to analyse images.

China’s lack of access to the best chips for AI training could further delay its efforts to catch up with the US, according to Phelix Lee, an equity analyst at Morningstar Asia.

American semiconductor giant Nvidia, which holds a virtual monopoly over high-end AI chips, is restricted by Washington from exporting its H100 and A100 chips to clients in China. The company now produces tailor-made chips, which are of lower performance, for the Chinese market.

Chinese AI “development may be bottlenecked by US restrictions if China is unable to increase hardware sufficiency, and the severity of the bottleneck depends on how sophisticated AI systems become”, Lee said.

The immensity of that challenge may well be illustrated by the reluctance of Chinese tech giants, save for Baidu, to show off any ChatGPT-like services to the public.

Alibaba Group Holding, owner of the Post, has yet to provide a timetable for the launch of a commercial product based on its large language models, despite having invested in AI for years.

Tencent Holdings has not provided any launch plans either, only saying it “will keep investing in cutting-edge technologies”, such as machine learning.
Baidu, meanwhile, finds its Ernie Bot being constantly compared to ChatGPT. While the company’s shares gained 14 per cent on the February day that it announced plans to launch an intelligent chatbot, they lost 10 per cent on Ernie Bot’s launch day, when founder Robin Li Yanhong showed the technology with pre-recorded videos rather than a live demonstration.

Last month, Li admitted that Ernie Bot lagged behind ChatGPT for about “one or two months”. But he also played down the geopolitical implications of Ernie Bot, saying that it “isn’t a tool for China to compete against the United States”.

Sam Altman, CEO and co-founder of Open AI, speaks during an event at the Microsoft headquarters in Redmond, Washington in February. Photo: Bloomberg

Sam Altman, CEO and co-founder of Open AI, speaks during an event at the Microsoft headquarters in Redmond, Washington in February. Photo: Bloomberg

It is too early to predict how much revenue or profit companies can generate from the likes of ChatGPT, as businesses are still exploring real-life applications of these chat bots, according to Wang Kai, a senior equity analyst at Morningstar Asia.
“We are encouraged by the possibilities, but we still need to figure out how exactly [chatbots] will be monetised,” he said.

Baidu has said it wants to integrate Ernie Bot across all its existing businesses, starting with its search engine, to “reshape the way information is generated and presented”. The technology will eventually be used to support Baidu’s smart speaker Xiaodu, self-driving unit Apollo, and video platform iQiyi, the company said.

Over 650 Chinese organisations have announced partnerships with Ernie Bot, including smartphone brand Honor, travel-booking site Ctrip, carmaker Geely Auto, and electronics giants Lenovo Group and TCL, according to Baidu.

Still, even as more Chinese tech firms jump on the chatbot bandwagon, many might see their costly bets failing to pan out, according to Lu Yanxia, research director at information technology consultancy IDC.

Solely relying on large language models will not provide a sustained edge for any firm, Lu wrote in a research note in February. ChatGPT-like technologies will also have a limited impact on the market at the moment, while many related AI models might even become irrelevant in the long run, she said.

“The true revelation [of ChatGPT] is that these language models will evolve and contribute to the advent of general AI, and that the application of these language models will push for a paradigm shift in AI development and narrow down the industry chain,” the research concluded.

Some experts have gone as far as calling for tech companies and researchers around the world to pause the training of AI models more powerful than GPT-4

“AI systems with human-competitive intelligence can pose profound risks to society and humanity,” the Future of Life Institute wrote in an open letter this week, signed by Tesla founder Elon Musk, Apple co-founder Steve Wozniak and dozens of other tech veterans.

“Should we automate away all the jobs, including the fulfilling ones? Should we develop non-human minds that might eventually outnumber, outsmart, make us obsolete and replace us?” it asked.

“Such decisions must not be delegated to unelected tech leaders. Powerful AI systems should be developed only once we are confident that their effects will be positive and their risks will be manageable,” it said.
 
.
f84fd845552f9e6b762f0b6430c2a9b.jpg


Father of China’s Great Firewall raises concerns about ChatGPT-like services​

  • Fang said the rise of generative AI tools like ChatGPT, developed by Microsoft-backed OpenAI, pose a big challenge to governments
  • China’s powerful internet regulators have told Chinese tech companies not to offer ChatGPT access to the public
Fang Bingxing, considered the father of China’s Great Firewall, has raised concerns over GPT-4, warning that it could lead to an “information cocoon” as the generative artificial intelligence (AI) service can provide answers to everything.

Fang said the rise of generative AI tools like ChatGPT, developed by Microsoft-backed OpenAI and now released as the more powerful ChatGPT-4 version, pose a big challenge to governments around the world, according to an interview published on Thursday by Red Star News, a media affiliate to state-backed Chengdu Economic Daily.

“People’s perspectives can be manipulated as they seek all kinds of answers from AI,” he was quoted as saying.

Fang, a computer scientist and former government official, is widely considered the chief designer of China’s notorious internet censorship and surveillance system. He played a key role in creating and developing the Great Firewall, a sophisticated system of internet filters and blocks that allows the Chinese government to control what its citizens can access online.

The Great Firewall has been fortified over the past decade, blocking Chinese netizens’ access to a wide range of foreign websites and online services including Facebook, Twitter and Google.
Many expected that China’s heavily-censored internet would be a challenge for Chinese tech companies in developing a ChatGPT-like service because it is hard to predict and control answers.

China’s powerful internet regulators have told Chinese tech companies not to offer ChatGPT access to the public, and they need to inform the authorities before launching their own ChatGPT-like services, according to a report by Nikkei Asia in February, citing sources.

After Microsoft revealed its formidable AI-powered office toolkit, the frenzy set off by ChatGPT continues in China despite obvious gaps between China’s ChatGPT alternatives and their foreign peers.

Chinese search engine giant Baidu was first among local internet companies to roll out a ChatGPT-like service, calling it Ernie Bot, or Wenxin Yiyan in Chinese.

However, the debut of Ernie Bot on Thursday in Beijing was disappointing, sending its shares down 6.4 per cent for the day in Hong Kong. Baidu’s shares shot up on Friday morning after investment banks including Citigroup gave bullish outlooks on the performance of Baidu’s Ernie Bot in their reports, according to Bloomberg.

Fang also warned that when AI develops further, it could pose threats to humans. “Now it’s simply software used in an online chat-like scenario. If it’s incorporated into robots and cars, we need to stay vigilant for the potential harm they could do to humans.”

Similar warnings are not in short supply in China.
zhou-hongyi.jpg


Zhou Hongyi, a Chinese billionaire and co-founder and CEO of the internet security company Qihoo 360, said in February that ChatGPT may become self-aware and threaten humans within 2 to 3 years.

Many scientists have discredited such a scenario in which AI turns against humanity.
 
.
Ernie bot has been providing a great deal of amusement for Chinese netizens. It's obvious that Baidu is using an AI using native english language (probably a US based company) and translating it to Chinese, hence the wonky answers.
 
.
Ernie bot has been providing a great deal of amusement for Chinese netizens. It's obvious that Baidu is using an AI using native english language (probably a US based company) and translating it to Chinese, hence the wonky answers.


  • One influencer posted several AI-generated images, asking if Baidu simply translated the Chinese into English and used foreign image generators
  • By Thursday noon, Ernie Bot could differentiate a crane bird from the machine, and did not mix up turkey and the country

Chinese tech giant Baidu, which last week launched its ChatGPT alternative Ernie Bot, said on Thursday that the product was “totally self-developed” after some users expressed concerns that the company may have copied its chatbot’s text-to-image capability from overseas.

Hilarious images generated by the Ernie Bot started to surface online earlier this week, as users found the chatbot drew a turkey, the bird, when asked for the country Turkey, and a crane - the bird - instead of the machine used for lifting heavy objects. These images were generated in spite of the Chinese-language prompts and use of completely different characters for each word.

Art influencer Liu Dake posted several of the artificial intelligence-generated images on Wednesday night, questioning if the Baidu product simply “translated the Chinese prompt into English and put it in foreign image generators like "Stable Diffusion”.

He also said Ernie Bot would by default create a white person if nationality was not specified.


Chinese AI is already biasing towards the white man :rofl:
 
Last edited:
.
“Censorship could certainly hinder China’s ability to develop a local equivalent to ChatGPT,” Dahlia Peterson, a research analyst at Georgetown University’s Centre for Security and Emerging Technology, said in February.

“Even if [Chinese] AI companies are able to access and utilise global data and research resources to train their AI models, it is unlikely Chinese authorities will allow them to use any material deemed as politically sensitive in their replies,” she added.
I guess, there are advantages and disadvantages to everything. This will be one of the disadvantages of the great firewall and censorship . I think that policy is long outdated and shiyld be revoked. It has had its time, has stayed for longer than should have.
Just like one Child policy it seems its hard to change policy on such matters due to entrenched interest groups as well.
Time will tell anyway.
 
.
I guess, there are advantages and disadvantages to everything. This will be one of the disadvantages of the great firewall and censorship . I think that policy is long outdated and shiyld be revoked. It has had its time, has stayed for longer than should have.
Just like one Child policy it seems its hard to change policy on such matters due to entrenched interest groups as well.
Time will tell anyway.

Well ChatGPT3 has constraints that make it sound stupid.

For instance you can get it to give nonsensical illogical answers if you go into regions it has been taught to be sensitive about...and even when you point it out it says it can't override the protocol.

For instance you can do things sort of like this.

grass.png


bigfoot.png


ants.png


cow.png


pliers.png


footprints.png


apple.png



cats.png
 
Last edited:
.
Actually China's NLP combined system is not ErnieBOT but WuDao family.

ErnieBOT is Baidu's image from text generation AI which is similar to OpenAI's DALL-E both using Chinese developed Residual Neural Network (ResNet) fundamental basis... something that is currently still the underlying basis for image generation field's Deep Learning.

WuDao is built differently to GPT family though. GPT scours the internet's text while WuDao combines text and image for Deep Learning. GPT family uses dense model while WuDao uses mixed experts model of learning. Parameter comparison is not 1:1 ... if so WuDao is magnitudes higher but they approach the problem from different angles. Just like how there are different ways to perform quantum computing where both China and US occupy all paths but each focus on different paths... until in recent years the US also started seeing more promise in photon/sub particle sampling based quantum computing.

Comparing ErnieBOT to GPT is like comparing a truck to a F1 racecar. Different things.

WuDao certainly is behind GPT in public use and commercialization. OpenAI and US AI industry generally is ahead of China's at the moment due to many reasons in many ways - language of world, data collection, censorship, tech crackdown, economic and political models and systems with distinct advantages and disadvantages etc. Despite those factors, US entrepreneurial culture is much less risk averse not to mention how much capital is available for investment and use and exposure to risk tolerance. China would need to be much wealthier per capita before it can compete in this risk tolerance and entrepreneurial on high risk endeavors outside of state or small time private funded efforts.

Despite this, China's application in industrial use AI and narrow AI is high and it's focused a lot on industrial application but behind on services replacement or aid systems. This AI race is certainly started though and the sure to exist competition will probably not allow either side to slow down on thinking about control. China's own inherent restrictions probably will receive some policy reform on tech crackdown attitudes particularly in computer science and software engineering re any AGI field.
 
Last edited:
.

SCMP: ChatGPT sparks investment frenzy and soul searching in China’s artificial intelligence drive

  • While China had declared AI strategically important as early as 2018, ChatGPT has shattered illusions about the country’s technological prowess
  • A censored internet, compounded by the lack of access to advanced chips, could hinder China’s ambitions to create a true equivalent to ChatGPT
China has been pouring billions of dollars into artificial intelligence development, but censorship and technological limitations may hinder the country’s drive to build a a true competitor to ChatGPT. Illustration: Lau Ka-kuen

China has been pouring billions of dollars into artificial intelligence development, but censorship and technological limitations may hinder the country’s drive to build a a true competitor to ChatGPT. Illustration: Lau Ka-kuen

When the world first witnessed the power of OpenAI’s conversational bot ChatGPT late last year, one social media post quickly went viral in China, attempting to explain why this artificial intelligence (AI) breakthrough did not happen in the country.

The most widely-shared answer, provided by an anonymous author, was that Chinese technology firms were just too short-sighted to bear the cost of long-term investment, choosing instead to rush towards technologies that can be quickly commercialised.

“When the kid next door publishes a revolutionary doctorate paper, don’t ask why that kid is so smart,” it said. “You also have a smart kid in your house, but instead of supporting his study, you asked him to make quick money while he was still able to perform manual labour.”


Many netizens find the metaphor apt in describing the root of China’s technological shortcomings. Despite strong policy and financial support by the state, as well as ample private investment, the country has been unable to beat the US to the punch in creating a cutting-edge AI chatbot like ChatGPT.

In 2018, President Xi Jinping conducted a special study session with the Politburo. It concluded that AI was strategically important, and could lead to a technological revolution and industrial changes with “profound impact on economic development, social progress, and the pattern of the international political economy”.

With the blessing of China’s top leadership, government and private funding poured into domestic AI start-ups.

In the ensuing years, the country saw the emergence of the “four little dragons” – Cloudwalk Technology, Megvii, SenseTime, and Yitu – all focused on the AI field of visual recognition.

Meanwhile, commercial products bearing the AI label have flooded the Chinese market. SenseTime, for instance, launched a robot designed solely for teaching kids how to play chess.

By 2021, Chinese firms claimed to have produced 21 large language models, up from just two in 2020, putting them on a par with the United States. A large language model, according to AI chip designer Nvidia, represents a deep-learning algorithm that can recognise, summarise, translate, predict and generate text and other content based on knowledge gained from massive data sets.

But the arrival of ChatGPT shattered the illusion that China and the US were competing neck and neck in AI.

Zhou Hongyi, founder of 360 Security Technology, says China’s AI development lags behind the level of OpenAI. Photo: Shutterstock

Zhou Hongyi, founder of 360 Security Technology, says China’s AI development lags behind the level of OpenAI. Photo: Shutterstock

China’s knowledge level in AI is two to three years behind OpenAI, the San Francisco-based start-up that created ChatGPT, said Zhou Hongyi, founder of cybersecurity firm 360 Security Technology and an industry veteran with close ties to Chinese authorities, at the China Development Forum last weekend.

That technological gap, however, has not deterred Chinese companies and entrepreneurs from touting their own plans to launch their own ChatGPT rivals in the country, where the chatbot is not officially available, because of the government’s attitude towards uncensored content.

In March, internet search giant Baidu launched Ernie Bot, becoming the first major tech company in China to launch its own GPT-like service. Wang Huiwen, co-founder of on-demand services giant Meituan, and Lee Kai-fu, former China head of Google, have both started new ventures to explore the business potential of generative AI.

But analysts caution that this gold rush could be short-lived owing to lack of technical expertise and experience, compounded by US export restrictions on AI chips, which would hinder the development of a true ChatGPT-equivalent in China.

Lee Kai-fu, former head of Google China, has launched a new venture looking into the business potential of ChatGPT-like technologies. Photo: Edmond So

Lee Kai-fu, former head of Google China, has launched a new venture looking into the business potential of ChatGPT-like technologies. Photo: Edmond So

The fanfare around ChatGPT only shows how much the market is craving for a new investment narrative, according to Bo Pei, an equity analyst at Tiger Securities. “After so many years of development, both the Western and Chinese internet industries are saturated and thirsting for a new direction.”

“It is questionable how soon ChatGPT-like tools will actually make an impact or produce meaningful revenue,” Bo said.

One big obstacle is China’s walled internet. With the Chinese government prohibiting the country’s more than 1 billion internet users from accessing uncensored content, the materials that researchers can use to train AI engines are more limited than in the West.

A random test conducted by the Post last month, for example, found that Baidu’s Ernie Bot was unable to answer questions related to topics deemed politically sensitive by Beijing. When asked if China was a democratic nation, the chatbot ducked the question, simply replying that it “hasn’t learned how to answer this question yet”.

Baidu CEO Robin Li Yanhong introduces the functions of Ernie Bot during a launch event in Beijing on March 16. Photo: AP Photo

Baidu CEO Robin Li Yanhong introduces the functions of Ernie Bot during a launch event in Beijing on March 16. Photo: AP Photo

“Censorship could certainly hinder China’s ability to develop a local equivalent to ChatGPT,” Dahlia Peterson, a research analyst at Georgetown University’s Centre for Security and Emerging Technology, said in February.

“Even if [Chinese] AI companies are able to access and utilise global data and research resources to train their AI models, it is unlikely Chinese authorities will allow them to use any material deemed as politically sensitive in their replies,” she added.

While censorship will not stop China from coming up with its own answers to ChatGPT, much in the same way that the country developed its own search engines after Google pulled out of the market, it could take two to three years for Chinese industry players to develop models that are at least 80 per cent as powerful as ChatGPT, according to research company Third Bridge.

And as China continues to fence off its internet, its gap with global AI leaders, such as the US, could widen. Within just four months after the public launch of ChatGPT in November, OpenAI released its next-generation language prediction model GPT-4, which has more sophisticated capabilities, including the ability to analyse images.

China’s lack of access to the best chips for AI training could further delay its efforts to catch up with the US, according to Phelix Lee, an equity analyst at Morningstar Asia.

American semiconductor giant Nvidia, which holds a virtual monopoly over high-end AI chips, is restricted by Washington from exporting its H100 and A100 chips to clients in China. The company now produces tailor-made chips, which are of lower performance, for the Chinese market.

Chinese AI “development may be bottlenecked by US restrictions if China is unable to increase hardware sufficiency, and the severity of the bottleneck depends on how sophisticated AI systems become”, Lee said.

The immensity of that challenge may well be illustrated by the reluctance of Chinese tech giants, save for Baidu, to show off any ChatGPT-like services to the public.

Alibaba Group Holding, owner of the Post, has yet to provide a timetable for the launch of a commercial product based on its large language models, despite having invested in AI for years.

Tencent Holdings has not provided any launch plans either, only saying it “will keep investing in cutting-edge technologies”, such as machine learning.
Baidu, meanwhile, finds its Ernie Bot being constantly compared to ChatGPT. While the company’s shares gained 14 per cent on the February day that it announced plans to launch an intelligent chatbot, they lost 10 per cent on Ernie Bot’s launch day, when founder Robin Li Yanhong showed the technology with pre-recorded videos rather than a live demonstration.

Last month, Li admitted that Ernie Bot lagged behind ChatGPT for about “one or two months”. But he also played down the geopolitical implications of Ernie Bot, saying that it “isn’t a tool for China to compete against the United States”.

Sam Altman, CEO and co-founder of Open AI, speaks during an event at the Microsoft headquarters in Redmond, Washington in February. Photo: Bloomberg

Sam Altman, CEO and co-founder of Open AI, speaks during an event at the Microsoft headquarters in Redmond, Washington in February. Photo: Bloomberg

It is too early to predict how much revenue or profit companies can generate from the likes of ChatGPT, as businesses are still exploring real-life applications of these chat bots, according to Wang Kai, a senior equity analyst at Morningstar Asia.
“We are encouraged by the possibilities, but we still need to figure out how exactly [chatbots] will be monetised,” he said.

Baidu has said it wants to integrate Ernie Bot across all its existing businesses, starting with its search engine, to “reshape the way information is generated and presented”. The technology will eventually be used to support Baidu’s smart speaker Xiaodu, self-driving unit Apollo, and video platform iQiyi, the company said.

Over 650 Chinese organisations have announced partnerships with Ernie Bot, including smartphone brand Honor, travel-booking site Ctrip, carmaker Geely Auto, and electronics giants Lenovo Group and TCL, according to Baidu.

Still, even as more Chinese tech firms jump on the chatbot bandwagon, many might see their costly bets failing to pan out, according to Lu Yanxia, research director at information technology consultancy IDC.

Solely relying on large language models will not provide a sustained edge for any firm, Lu wrote in a research note in February. ChatGPT-like technologies will also have a limited impact on the market at the moment, while many related AI models might even become irrelevant in the long run, she said.

“The true revelation [of ChatGPT] is that these language models will evolve and contribute to the advent of general AI, and that the application of these language models will push for a paradigm shift in AI development and narrow down the industry chain,” the research concluded.

Some experts have gone as far as calling for tech companies and researchers around the world to pause the training of AI models more powerful than GPT-4

“AI systems with human-competitive intelligence can pose profound risks to society and humanity,” the Future of Life Institute wrote in an open letter this week, signed by Tesla founder Elon Musk, Apple co-founder Steve Wozniak and dozens of other tech veterans.

“Should we automate away all the jobs, including the fulfilling ones? Should we develop non-human minds that might eventually outnumber, outsmart, make us obsolete and replace us?” it asked.

“Such decisions must not be delegated to unelected tech leaders. Powerful AI systems should be developed only once we are confident that their effects will be positive and their risks will be manageable,” it said.
I guess, there are advantages and disadvantages to everything. This will be one of the disadvantages of the great firewall and censorship . I think that policy is long outdated and shiyld be revoked. It has had its time, has stayed for longer than should have.
Just like one Child policy it seems its hard to change policy on such matters due to entrenched interest groups as well.
Time will tell anyway.
The firewall only blocks sensitive political information. There is no obstacle for natural science information in and out. How can political issues become a problem for AI development? Absurd.
 
.
.
Back
Top Bottom