PaLM vs InstructGPT

PaLM (Pathways Language Model) is a 540-billion-parameter language model developed by Google and announced in April 2022. The model was trained using Google's Pathways system, a new ML architecture designed to efficiently train models across thousands of accelerator chips. PaLM demonstrated strong few-shot performance across reasoning tasks, code generation, and multilingual understanding, includi...

InstructGPT is a family of large language models introduced by OpenAI in 2022, designed to align artificial intelligence outputs with human intent. Developed as an evolution of the GPT-3 model, it was trained using reinforcement learning from human feedback (RLHF) to follow specific instructions rather than just predicting the next word. This methodology reduced harmful outputs and allowed the mod...