top of page

Search


Training Harmless AI at Scale
This article explores Constitutional AI, a framework developed by Anthropic to train AI systems that are helpful, harmless, and non-evasive—without relying on human labels for harmfulness. By guiding models through critique–revision loops and reinforcement learning from AI-generated feedback, this method offers a scalable, transparent alternative to RLHF and advances the field of AI alignment and self-supervised safety

Juan Manuel Ortiz de Zarate
May 811 min read


Foundation Models
Foundation models like GPT-3 and CLIP are reshaping AI by enabling general-purpose systems trained on massive, unlabelled data. This article explores their key concepts—emergence and homogenization—their capabilities across language, vision, and more, and the risks they pose, from bias to environmental impact. Based on the Stanford report, it highlights why foundation models are powerful, unpredictable, and demand responsible development.

Juan Manuel Ortiz de Zarate
May 79 min read


How Bigger Models Get Better
This article explores the groundbreaking findings of Kaplan et al. on scaling laws for neural language models. It explains how model performance improves predictably with increased model size, dataset size, and compute budget, highlighting power-law relationships. The piece discusses implications for efficient AI training, optimal resource allocation, overfitting avoidance, and future research directions.

Juan Manuel Ortiz de Zarate
Apr 3010 min read


Can a Chatbot Make Us Feel Better (or Worse)?
Can AI chatbots comfort us—or make us dependent? A study explores ChatGPT's emotional impact and the ethics of affective design.

Juan Manuel Ortiz de Zarate
Apr 49 min read


The Brains Behind AI’s Evolution
Discover how neural networks power modern AI, from deep learning to generative models, shaping the future of technology and innovation.

Juan Manuel Ortiz de Zarate
Mar 149 min read


Benchmarking AI Across Disciplines
SuperGPQA evaluates LLMs across 285 disciplines with 26,529 questions, testing their reasoning and knowledge beyond traditional fields.

Juan Manuel Ortiz de Zarate
Feb 269 min read


AI That Thinks Before It Speaks
Optimizing AI reasoning with adaptive test-time computation using recurrent depth transformers for smarter, efficient problem-solving.

Juan Manuel Ortiz de Zarate
Feb 199 min read


AI, enhancer or threat?
AI is not just replacing jobs; it's empowering 10x professionals, and amplifying their impact in marketing, recruitment, and beyond.

Juan Manuel Ortiz de Zarate
Feb 139 min read


Saving AI from Itself: How to Prevent Model Collapse
Active Inheritance curates synthetic data to control LLM behavior, preventing AI model collapse and improving diversity, safety, and bias.

Juan Manuel Ortiz de Zarate
Feb 68 min read


DeepSeek, the game-changing model
DeepSeek R1 enhances AI reasoning with reinforcement learning and distillation, achieving top-tier performance while maintaining efficiency

Juan Manuel Ortiz de Zarate
Jan 319 min read


Measuring Intelligence: Key Benchmarks and Metrics for LLMs
A comprehensive review of essential benchmarks and metrics for evaluating Large Language Models, from accuracy to fairness and conversationa

Juan Manuel Ortiz de Zarate
Nov 8, 202410 min read


Orca: The New LLM Teacher
Orca 2: A smaller AI model that rivals larger ones by mastering task-specific reasoning, achieving high performance with less computation.

Juan Manuel Ortiz de Zarate
Oct 9, 20249 min read


Data Balancing With K-Means
A clustering-based method balances web-scraped datasets, improving AI model performance by ensuring diverse and uniform data representation.

Juan Manuel Ortiz de Zarate
Oct 4, 20249 min read


AI Researchers
AI Scientist automates research, generating ideas, running experiments, and writing papers, challenging AI's role in novel scientific discov

Juan Manuel Ortiz de Zarate
Aug 27, 20249 min read


Understanding what the ML models have learned
Models could spread bias and discrimination if you don't know what they have learned. Here we show a technique to prevent it.

Juan Manuel Ortiz de Zarate
Aug 2, 202410 min read


Biases in LLMs
Explore the hidden biases in LLMs and their impact. The opinions of which sector of society are reflected in them?

Juan Manuel Ortiz de Zarate
Jul 17, 202410 min read


Measuring Controversy in Social Networks through NLP
Discover how NLP tools can identify and analyze contentious topics.

Juan Manuel Ortiz de Zarate
Jul 6, 202410 min read


Retrieval Augmented Generation: Increasing knowledge of your LLM
Dive into the world of Retrieval-Augmented Generation! See how RAG transforms AI responses by blending retrieval with generation.

Juan Manuel Ortiz de Zarate
May 24, 20249 min read


The Mathematics of Language
Computers model text with vectors. Using Word2Vec, FastText, and Transformers, they understand and generate context-aware text. Learn how!

Juan Manuel Ortiz de Zarate
May 24, 20249 min read


Analyzing Discourse with Artificial Intelligence: What is Argumentation Mining?
Are political discourses consistent? Is a judgment fair? In this article, we'll explore argumentation mining, an AI field to analyze debates
Cristian Cardellino
Apr 21, 202410 min read
bottom of page