How deep you are involved with Natural Language Processing (NLP)
Thread poster: Joel Pina Diaz
Joel Pina Diaz
Joel Pina Diaz  Identity Verified
Mexico
Local time: 06:08
English to Spanish
+ ...
May 17, 2020

Among several, the neural network-based technique for natural language processing (NLP) pre-training, called Bidirectional Encoder Representations from Transformers, or "BERT", is changing your models to search either from ranking and/or featured snippets cracking your queries mostly in US English but near future will add several languages (a market open for translators).

"One of the biggest challenges in natural language processing (NLP) is the shortage of training data. Because N
... See more
Among several, the neural network-based technique for natural language processing (NLP) pre-training, called Bidirectional Encoder Representations from Transformers, or "BERT", is changing your models to search either from ranking and/or featured snippets cracking your queries mostly in US English but near future will add several languages (a market open for translators).

"One of the biggest challenges in natural language processing (NLP) is the shortage of training data. Because NLP is a diversified field with many distinct tasks, most task-specific datasets contain only a few thousand or a few hundred thousand human-labeled training examples. However, modern deep learning-based NLP models see benefits from much larger amounts of data, improving when trained on millions, or billions, of annotated training examples. To help close this gap in data, researchers have developed a variety of techniques for training general purpose language representation models using the enormous amount of unannotated text on the web (known as pre-training). The pre-trained model can then be fine-tuned on small-data NLP tasks like question answering and sentiment analysis, resulting in substantial accuracy improvements compared to training on these datasets from scratch..."

Language understanding remains an ongoing challenge and we are in the trend to ride up...

Full information in the following link (Google A.I. Blog): https://ai.googleblog.com/2018/11/open-sourcing-bert-state-of-art-pre.html
Collapse


 


To report site rules violations or get help, contact a site moderator:

Moderator(s) of this forum
Maria Castro[Call to this topic]

You can also contact site staff by submitting a support request »

How deep you are involved with Natural Language Processing (NLP)






CafeTran Espresso
You've never met a CAT tool this clever!

Translate faster & easier, using a sophisticated CAT tool built by a translator / developer. Accept jobs from clients who use Trados, MemoQ, Wordfast & major CAT tools. Download and start using CafeTran Espresso -- for free

Buy now! »
Protemos translation business management system
Create your account in minutes, and start working! 3-month trial for agencies, and free for freelancers!

The system lets you keep client/vendor database, with contacts and rates, manage projects and assign jobs to vendors, issue invoices, track payments, store and manage project files, generate business reports on turnover profit per client/manager etc.

More info »