Developing an LLM: Building, Training, Finetuning
If your weekend plans include catching up on AI developments and understanding Large Language Models (LLMs), I’ve prepared…
ai
LLM Research Insights: Instruction Masking and New LoRA Finetuning Experiments
This month, I am covering three new papers related to instruction finetuning and parameter-efficient finetuning with LoRA in…
How Good Are the Latest Open LLMs? And Is DPO Better Than PPO?
April 2024, what a month! My birthday, a new book release, spring is finally here, and four major…
Meet the Discovery Collector robot!
FIXEDD ???????? Revolutionizing Barn Cleaning with AI-Powered Technology!
Using and Finetuning Pretrained Transformers
This week has been filled with developments, including exciting new AI research that I’ll be discussing in my…
Auto Drawings
https://aecmag.com/technology/aec-magazine-march-april-2024-edition
AI and Open Source in 2023
We are slowly but steadily approaching the end of 2023. I thought this was a good time to…
Research Papers in Oct 2023: A Potential Successor to RLHF for Efficient LLM Alignment and the Resurgence of CNNs
From Vision Transformers to innovative large language model finetuning techniques, the AI community has been very active with…
Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
Low-rank adaptation (LoRA) is among the most widely used and effective techniques for efficiently training custom LLMs. For…
Research Papers in Nov 2023: Tackling Hallucinations, Boosting Reasoning Abilities, and New Insights into the Transformer Architecture
This month, I want to focus on three papers that address three distinct problem categories of Large Language…