Simon Banks

Toloka is supporting new research at CLEF 2025 through the ELOQUENT lab, which focuses on evaluating the real-world usefulness of generative language models. As part of the lab’s work on modelling human preferences, Zoia Butenko – a researcher at the University of Oslo’s Language Technology Group – led the annotation effort for a new dataset.

A lot of the concern around AI security is focused in the wrong place. While executives debate whether their data is safe, the real question is whether they understand what they're actually buying.

Large Language Models (LLMs) are changing how we generate text, from

drafting emails to answering customer queries. Yet anyone who’s deployed

an LLM-powered application knows there’s a potential content quality

problem: these models can produce output that sounds fluent but may be

factually wrong, unhelpfully vague, culturally insensitive, or misaligned with

expert knowledge.

Platforms like Stake offer a new path to long-term wealth, helping you turn spare income into steady returns from real estate without needing to buy a whole property

Knowing your guest is at the heart of any personalized hospitality. When a restaurant tracks preferences and dining habits, it can create experiences that feel special and thoughtful rather than transactional. If a guest loves window seats or prefers sparkling water, that shouldn’t be left to chance or memory.
When you create the right guest profiles, you can turn data into meaningful insights that help you make guests feel valued from the moment they walk through the door.

The quality of human feedback in AI development can be the difference between a slightly better model and a true breakthrough. While large language models might learn from oceans of internet data, specialized use cases often call for something more refined: real domain expertise that guarantees AI systems reflect genuine professional knowledge rather than simplified approximations.

Ninety per cent of property professionals say they're ready to invest in new tech. Surprising? Not if you actually work in real estate. The industry has gotten a bad rap as tech-resistant, but that's not the whole picture.

As large language models (LLMs) continue to evolve in sophistication and capability, the methods we use to evaluate them need to keep up. Among these methods, the "LLM-as-a-judge" concept has emerged as a notable paradigm for assessing model performance.
The technique uses the analytical capabilities of LLMs to evaluate AI-generated outputs, including their own.

Running a business comes with enough stress already, and the last thing you need is to lose sleep over cash flow gaps or unexpected expenses. While traditional business finance has its place, a business credit card can offer peace of mind, giving you a flexible financial buffer that’s there whenever you need it.

Behind every major scientific advancement lies countless human contributions. Some are from renowned researchers in sterile labs, others from ordinary people sharing their time, data, and experiences.

Buying your first home can often feel completely unachievable. Let’s take a look at how someone might be able to use Kaldi to build towards their deposit using Kaldi. Let’s call them Yusuf.

The US and the UK prioritize innovation in their approaches to AI governance, though in very different ways. Prolific polled its participants to find out what the public thinks about these approaches: do they trust them? Do they even understand them?

Get the lowdown on how to use Meta ads to your advantage and reach potential diners on Facebook and Instagram.

Restaurant sustainability practices can start small. You don’t need a complete overhaul to make meaningful change, with simple adjustments often having an environmental impact while even saving money.

Business credit cards work similarly to personal cards but are designed specifically for company expenses. They let you borrow money for business costs and pay it back later, often with rewards for typical business spending. While they share some features with personal cards, business credit cards usually offer higher limits and perks tailored to entrepreneurs.