Language pre-trained models are amazing but they are also going to push the ethical boundaries of the current generation of AI companies.