FIXEDD 
Research Papers in Jan 2024: Model Merging, Mixtures of Experts, and Towards Smaller LLMs
2023 was the year when the potential and complexity of Large Language Models (LLMs) were growing rapidly. Looking…
Improving LoRA: Implementing Weight-Decomposed Low-Rank Adaptation (DoRA) from Scratch
Low-rank adaptation (LoRA) is a machine learning technique that modifies a pretrained model (for example, an LLM or…
Research Papers in February 2024: A LoRA Successor, Small Finetuned LLMs Vs Generalist LLMs, and Transparent LLM Research
Once again, this has been an exciting month in AI research. This month, I’m covering two new openly…
Tips for LLM Pretraining and Evaluating Reward Models
It’s another month in AI research, and it’s hard to pick favorites. Besides new research, there have also…
Thomas Flannery: delivering digital for McLaren Construction
Improving digital construction was the brief McLaren Construction gave Thomas Flannery when he joined in late 2022, and…
Learning from Crossrail’s information management challenge
Nearly a month ago, BIMplus highlighted how the Crossrail project team learned the hard way the trouble associated…
Contractors and tech innovators needed for smarter safety regs
A public-private accelerator is looking for contractors and technology suppliers to join a project aimed at exploring the…
Digital Construction Week adds Manchester show
The organisers of Digital Construction Week (DCW) have launched a second show, Digital Construction North (DCN), that will…
Gatwick tackles buried assets and biodiversity with GIS
London Gatwick has created a new geospatial platform using Esri UK’s GIS technology to reduce accidental strikes on…