Something I find intriguing considering recent studies, is the fact that certain fine-tuning and gradient techniques don’t primarily aim to infuse the language model with domain-specific data.

Instead, their primary goal is to alter the model’s behaviour and instruct it in specific tasks through the design and structure of the fine-tuning data.

These tasks encompass functionalities like reasoning, self-correction and handling large context better. IN2 is yet another example of this approach.

The Problem

Currently a number of large language models (LLMs) can receive as input lengthy text. Something we refer to as the context window, or large context window.

However, LLMs still struggle to fully utilise information within the long context, known as the lost-in-the-middle challenge. This is the phenomenon where emphasis is being placed by the LLM on information at the beginning and the end of the corpus of data submitted. While neglecting the middle portion, when a questions is asked over the body of data.

The root cause of lost-in-the-middle stems from the unintentional bias hidden in the general training data.

The Solution

A recent study has the view that insufficient explicit supervision during the long-context training is to blame for this phenomenon.

Explicit supervision should explicitly emphasise the fact that any position in a long context can hold crucial information.

Enter INformation-INtensive (IN2) Training

IN2 is a purely data-driven solution to overcome lost-in-the-middle.

IN2 training leverages a synthesised long-context question-answer dataset, where the answer requires two elements:

1. Fine-Grained information awareness on a short segment, within a synthesised long context.
2. The integration and reasoning of information from two or more short segments.

In auto-regressive pre-training, predicting the next token is often more influenced by nearby tokens rather than distant ones.

Similarly, in supervised fine-tuning, system messages that strongly impact response generation are usually placed at the beginning of the context. This can create a bias, suggesting that important information is always found at the beginning or end of the context.

INformation-INtensive (IN2) has as its focus, the training of the LLM to explicitly teach the model that crucial information can be intensively present throughout the context, not just at the beginning and end.

IN2 is a purely data driven solution.

The How Of IN2

The long context, spanning from 4K to 32K tokens, is compiled from numerous short segments of around 128 tokens each.

Question-answer (QA) pairs inquire about information located within one or more segments, which are randomly positioned within the long context.

Two types of questions are generated:

1. One demands detailed knowledge about a single short segment,
2. While the other necessitates integrating and reasoning about information from multiple segments.

These QA pairs are produced by instructing GPT-4-Turbo (OpenAI, 2023b) with specific guidelines and the raw segments.