FIXEDD 
25 groundworks firms win £100m Places for People deal
Housing group Places for People has picked its line-up of groundworks contractors to deliver new-build homes projects homes…
Precast firm FP McCann cleared after immigration raid
Immigration officials have decided to take no action against precast concrete contractor FP McCann after a dawn raid…
AI and Open Source in 2023
We are slowly but steadily approaching the end of 2023. I thought this was a good time to…
Research Papers in Oct 2023: A Potential Successor to RLHF for Efficient LLM Alignment and the Resurgence of CNNs
From Vision Transformers to innovative large language model finetuning techniques, the AI community has been very active with…
Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
Low-rank adaptation (LoRA) is among the most widely used and effective techniques for efficiently training custom LLMs. For…
Research Papers in Nov 2023: Tackling Hallucinations, Boosting Reasoning Abilities, and New Insights into the Transformer Architecture
This month, I want to focus on three papers that address three distinct problem categories of Large Language…
Ten Noteworthy AI Research Papers of 2023
This year has felt distinctly different. I’ve been working in, on, and with machine learning and AI for…
Understanding and Coding Self-Attention, Multi-Head Attention, Cross-Attention, and Causal-Attention in LLMs
This article will teach you about self-attention mechanisms used in transformer architectures and large language models (LLMs) such…
Research Papers in Jan 2024: Model Merging, Mixtures of Experts, and Towards Smaller LLMs
2023 was the year when the potential and complexity of Large Language Models (LLMs) were growing rapidly. Looking…
Improving LoRA: Implementing Weight-Decomposed Low-Rank Adaptation (DoRA) from Scratch
Low-rank adaptation (LoRA) is a machine learning technique that modifies a pretrained model (for example, an LLM or…