OpenAI libera el modelo GPT-2 de 1.5B

OpenAI acaba de liberar el modelo GPT-2 1.5B: openai.com/blog/gpt-2-1-5b-release/

GitHub modelo: github.com/openai/gpt-2

GitHub dataset: github.com/openai/gpt-2-output-dataset

Podemos probar el nuevo modelo en funcionamiento aquí: talktotransformer.com/

Yo he probado con el siguiente texto y es increíble el resultado (por ahora sólo funciona en inglés):

Entrada: In quantum mechanics, superdeterminism is a hypothetical class of theories that evade Bell's theorem by virtue of being completely deterministic. It is conceivable that someone could exploit this loophole to construct a local hidden variable theory that reproduces the predictions of quantum mechanics. Superdeterminists do not recognize the existence of genuine chances or possibilities anywhere in the cosmos. [Y GPT-2 continúa a partir de aquí con] There are no physical processes that could create such chances or possibilities, since no matter, even space-time itself, is fully describable as a quantum field.

In superdeterminism, the universe is not just "out there" somewhere. There is no such thing as "outside of the universe," as in the Copernican Principle. It is not "in our heads," as in the "mystery of the soul." Quantum mechanics does not describe a world that is either independent of our brains or somehow related to them, as in a common dualist view.

If we were to adopt a deterministic interpretation of quantum mechanics, we would have to conclude that there was no such thing as "me." "I" was an epiphenomenon of the quantum wavefunction, a placeholder for the properties of...

--------------------------------------------------------------------------------

Lo más impresionante es el último párrafo porque ¡realmente forma parte de la tesis del superdeterminismo cuántico! Y dudo mucho que el modelo haya sido entrenado con datos de este modelo cuántico que casi nadie conoce ni suele tener en cuenta.

El texto original de entrada lo saqué de la web de la física Sabine: backreaction.blogspot.com/2019/07/the-forgotten-solution-superdetermin