The GPT-3 model has created a lot of buzz in the technology world. Experts have called it “amazing” and “impressive”, and some have even described it as “the most powerful language model ever built.” So, what’s GPT-3, and what’s all the hype about?
GPT-3 is short for third-generation Generative Pre-trained Transformer. It’s a machine learning language model that uses data from the internet to create text. OpenAI, a nonprofit from California, is behind the GPTs. In its third rendering from 2020, the GPT-3 model uses 175 billion parameters. In comparison, its predecessor only had 1.5 billion parameters.
Once primed by a human, it can come up with any type of text. With minimal human input, it’s generated creative fiction, working code, business memos, recipes, ads, and even academic research papers. No other language computer has ever come close to this.
This makes GPT-3 one of the most powerful AI-based language technologies in the world.
Simply put, GPT-3 is a very sophisticated text predictor. After receiving human text input, it delivers its best guess as to what the next part should be. It then takes the original input and the first text it’s produced and uses this as a new base to generate more output, and so on.
Its database is all text that’s available on the internet. Based on what GPT-3 finds online, it produces the content it considers statistically the most plausible to follow the original input.
GPT-3s take what humans give them and use their sophisticated neurological network architecture to transform it into a logical outcome.
“Transformers like GPT-3 learn how language works, how sentences are constructed, which kind of sentence follows the next sentence and how to leverage the current context,” says AI specialist Fréderic Godin, Head of AI at Chatlayer by Sinch.
In his experience, GPT-3 transformers produce highly accurate and grammatically correct texts.
However, as impressive as the new technology is, it also has its shortcomings.
While GPT-3s can come up with impressive texts, they have no internal understanding of their meaning. They lack semantic and pragmatic context, and therefore the ability to fully understand the input they receive and the output they deliver.
In addition, they can’t reason about a subject in an abstract way, and they also have no common sense. If they’re asked to talk about a concept they haven’t encountered before, GPT-3 models aren’t able to come up with a reasonable answer on their own.
Instead, they “invent” answers that they deem to be the most plausible, even if the responses are incorrect or nonsensical.
Let’s say you were to ask a GPT-3 about the soda prices of a telecommunication company. Of course, you know that the company doesn’t sell drinks, but you ask the GPT-3 anyway. Nevertheless, the GPT-3 would name a price that it considers plausible. This points to a common issue of GPT-3s: they have difficulties working with knowledge they don’t have.
This can be far more problematic than getting a wrong answer about sodas. In the past, GPT-3 has written insulting, racist, and sexist texts.
GPT-3 could even produce dangerous content. If a user asked a GPT-3 how to relax after a long day at work, based on online information, the GPT-3 could, without realizing it, recommend harmful medication.
“Unfortunately, there is no full control on the output of a GPT3.” Fréderic Godin, Head of AI at Chatlayer by Sinch
None of this means that GPT-3 isn’t an impressive new technology, but it also shows that it requires a lot more teaching and training for it to be fully functional in the real world.
However, GPT-3 already shows some promise as a search tool, and as assisting technology for conversational AI.
Search engines that work with artificial intelligence (AI) typically combine machine learning, conversational AI, and search algorithms. If you’ve ever interacted with smart virtual assistants like Alexa or Siri, you’ve used this type of technology.
Improve user experiences for online searches
Despite its shortcomings, GPT-3 shows how the future of search might look like. Rather than typing some carefully picked keywords, you can simply ask it a question and receive an answer – much more user-friendly than a list of search results!
Moreover, even if it does not know the answer, future generations of GPT3 or other Transformer-based AI models might browse the web to find the right answer.
Imagine a real estate website. Here, a customer could simply ask a chatbot to find them a three-bedroom house in Denver with a maximum price of 600,000 dollars. The chatbot would then use this input to search the site and show the best results.
Training NLP models
Another use case for GPT-3 could be to use it to train NLP models.
NLP (natural language processing) is the technology conversational AI bots use to understand human speech and text and reply like a human would. In order to train NLP models, you have to feed them with typical human expressions.
This sounds easy, but think for example of all the things we could say to order a pizza. Conversation designers have to teach NLP models as many of these expressions as possible to make sure that the chatbots will understand the customer’s pizza order. This takes time, and it’s nearly impossible to cover all possible expressions.
Chatbot designers could use GPT-3 to speed up this process and make conversational AI bots even more accurate.
Even though, at this point, these use cases are merely a glimpse at future possibilities, it will be interesting to see how GPT-3 will develop and influence other (conversational) technologies in the future.
When you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. This information might be about you, your preferences or your device and is mostly used to make the site work as you expect it to. The information does not usually directly identify you, but it can give you a more personalized web experience. Because we respect your right to privacy, you can choose not to allow some types of cookies. Click on the different category headings to find out more and change our default settings. However, blocking some types of cookies may impact your experience of the site and the services we are able to offer.
Cookie Statement
These cookies are necessary for the website to function and cannot be switched off in our systems. They are usually only set in response to actions made by you which amount to a request for services, such as setting your privacy preferences, logging in or filling in forms. You can set your browser to block or alert you about these cookies, but some parts of the site will not then work.
These cookies do not store any personally identifiable information.
Cookie details
Cookie Subgroup | Cookies | Cookies used |
---|---|---|
eu5.mm.sdi.sinch.com | ASP.NET_SessionId | First Party |
community.sinch.com | AWSALB , LiSESSIONID | First Party |
appengage.sinch.com | dd_cookie_test_ | First Party |
tickets.sinch.com | atlassian.xsrf.token , JSESSIONID | First Party |
cockpit2.sinch.com | SESSION | First Party |
engage.sinch.com | instapage-variant-xxxxxxxx | First Party |
dashboard.sinch.com | cookietest | First Party |
brand.sinch.com | PHPSESSID , AWSALBCORS | First Party |
sinch.com | __cf_bm , OptanonConsent , TEST_AMCV_COOKIE_WRITE , OptanonAlertBoxClosed , onesaasCookieSettings, QueryString, functional-cookies, performance-cookies, targeting-cookies, social-cookies lastExternalReferrer, lastExternalReferrertime, cookies, receive-cookie-deprecation _gdvisitor, _gd_session, _gcl_au, _fbp, _an_uid, _utm_zzses, lpv | First Party |
mediabrief.com | __cf_bm | Third Party |
recaptcha.net | _GRECAPTCHA | Third Party |
cision.com | __cf_bm | Third Party |
techtarget.com | __cf_bm | Third Party |
These cookies allow us to count visits and traffic sources so we can measure and improve the performance of our site. They help us to know which pages are the most and least popular and see how visitors move around the site. All information these cookies collect is aggregated and therefore anonymous.
If you do not allow these cookies we will not know when you have visited our site, and will not be able to monitor its performance.
Cookie details
Cookie Subgroup | Cookies | Cookies used |
---|---|---|
community.sinch.com | ValueSurveyVisitorCount | First Party |
buzz.sinch.com | instap-spid.8069 , instap-spses.8069 | First Party |
appengage.sinch.com | _dd_s | First Party |
sinch.com | AMP_TLDTEST , rl_page_init_referrer , rl_trait , _vis_opt_s , __q_state_dp56h9oqwhna9CoL , cb_user_id , __hstc , rl_anonymous_id , rl_user_id , initialTrafficSource , _vwo_uuid , _vwo_uuid_v2 , rl_page_init_referring_domain , _hjIncludedInSessionSample_xxx , apt.uid , __hssrc , test_rudder_cookie , cb%3Atest , __hssc , rl_group_trait , _hjAbsoluteSessionInProgress , _vwo_referrer , _vwo_sn , _vis_opt_test_cookie , _hjFirstSeen , _hjTLDTest , _hjSession_xxxxxx , s_sq , _vwo_ds , rl_group_id , _vis_opt_exp_n_combi , s_cc , _gclxxxx , cb_anonymous_id , cb_group_id , apt.sid , rl_session , _uetvid , AMP_899c7e29a9 , _hjSessionUser_xxxxxx | First Party |
brand.sinch.com | AMP_TEST | First Party |
engage.sinch.com | no-cache , instap-spses.85bb , instap-spid.85bb | First Party |
www.sinch.com | d-a8e6 , s-9da4 | First Party |
nr-data.net | JSESSIONID | Third Party |
sinch-en.newsroom.cision.com | _ga, _gid | Third Party |
sinch.in | _ga_xxxxxxxxxx, _gat_UA-XXXXXX-X, _gid, _ga | Third Party |
g.fastcdn.co | instap-spses.85bb | Third Party |
hello.learn.mailjet.com | pardot, visitor_id, visitor_id##### | Third Party |
www.googletagmanager.com | userId | Third Party |
hello.learn.mailgun.com | visitor_id#####, visitor_id | Third Party |
dev.visualwebsiteoptimizer.com | _vwo_ssm | Third Party |
box.com | box_visitor_id | Third Party |
app.box.com | z, cn | Third Party |
sinch-tfn.paperform.co | laravel_session | Third Party |
go.sinch.in | visitor_id#####, visitor_id | Third Party |
Qualified | __q_local_form_debug | Third party |
Rudderstack | rudder.inProgress, rudder.3156dd1f-7029-4600-ae54-baf147d9af20.queue, rudder.3156dd1f-7029-4600-ae54-baf147d9af20.ack, rudder.3156dd1f-7029-4600-ae54-baf147d9af20.reclaimStart, rudder.3156dd1f-7029-4600-ae54-baf147d9af20.reclaimEnd, | Third party |
6sense | _6senseCompanyDetauls, _6signalTTL | Third party |
Appcues | apc_local_id, apc_user | Third party |
These cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device.
If you do not allow these cookies, you will experience less targeted advertising.
Cookie details
Cookie Subgroup | Cookies | Cookies used |
---|---|---|
investors.sinch.com | visitor_id | First Party |
community.sinch.com | VISITOR_BEACON , LithiumVisitor | First Party |
sinch.com | _uetsid , ajs_user_id , _gcl_aw , ajs_group_id , AMCV_ , __utmzzses , _fbp , _gcl_au , AMCVS_ | First Party |
go.latam.sinch.com | visitor_id##### , pardot | First Party |
linkedin.com | li_gc, bcookie, lidc, AnalyticsSyncHistory, UserMatchHistory, li_sugr | Third Party |
pi.pardot.com | lpv151751, pardot | Third Party |
hsforms.com | _cfuvid | Third Party |
google.com | CONSENT | Third Party |
sinch.in | _gclxxxx, _gcl_au | Third Party |
www.linkedin.com | bscookie | Third Party |
bing.com | MUID, MSPTC | Third Party |
www.facebook.com | Third Party | |
hello.learn.mailgun.com | pardot | Third Party |
www.youtube.com | TESTCOOKIESENABLED | Third Party |
dev.visualwebsiteoptimizer.com | uuid | Third Party |
g2crowd.com | __cf_bm | Third Party |
pardot.com | visitor_id#####, visitor_id | Third Party |
tracking.g2crowd.com | _session_id | Third Party |
hubspot.com | __cf_bm, _cfuvid | Third Party |
doubleclick.net | test_cookie, IDE | Third Party |
youtube.com | CONSENT, VISITOR_PRIVACY_METADATA, VISITOR_INFO1_LIVE | Third Party |
go.sinch.in | pardot | Third Party |
liadm.com | lidid | Third Party |
www.google.com | _GRECAPTCHA | Third Party |
These cookies enable the website to provide enhanced functionality and personalisation. They may be set by us or by third party providers whose services we have added to our pages. If you do not allow these cookies, then some or all of these services may not function properly.
Cookie details
Cookie Subgroup | Cookies | Cookies used |
---|---|---|
portal.sinch.com | pnctest | First Party |
partner.appengage.sinch.com | _dd_s | First Party |
investors.sinch.com | First Party | |
community.sinch.com | LithiumUserInfo , LithiumUserSecure | First Party |
tickets.sinch.com | selectedidp | First Party |
engage.sinch.com | ln_or | First Party |
cockpit2.sinch.com | CSRF-TOKEN , NG_TRANSLATE_LANG_KEY | First Party |
sinch.com | apt.temp-xxxxxxxxxxxxxxxxxx , hubspotutk , ajs%3Acookies , cf_clearance , ajs%3Atest , __tld__ , __q_domainTest , pfjs%3Acookies , ajs_anonymous_id | First Party |
auth.appengage.sinch.com | AUTH_SESSION_ID , KEYCLOAK_3P_COOKIE , KEYCLOAK_3P_COOKIE_SAMESITE , KC_RESTART , AUTH_SESSION_ID_LEGACY | First Party |
www.recaptcha.net | _GRECAPTCHA | Third Party |
boxcdn.net | __cf_bm | Third Party |
d2oeshgsx64tgz.cloudfront.net | cookietest | Third Party |
sinch-np.paperform.co | XSRF-TOKEN, laravel_session | Third Party |
vimeo.com | __cf_bm, vuid | Third Party |
sinch-ca-sc.paperform.co | XSRF-TOKEN, laravel_session | Third Party |
box.com | site_preference | Third Party |
app.box.com | bv | Third Party |
sinch-tfn.paperform.co | XSRF-TOKEN | Third Party |
cision.com | cf_clearance | Third Party |
These cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.
Cookie details
Cookie Subgroup | Cookies | Cookies used |
---|---|---|
community.sinch.com | ln_or | First Party |
sinch.in | _fbp | Third Party |
youtube-nocookie.com | CONSENT | Third Party |
youtube.com | YSC | Third Party |