Ask about section 25, get section 25

You ask what section 25 of an ordinance requires. The answer comes back well written, correctly cited, every quote verbatim — about section 5.

Everything in it is true. It is still useless, and worse than useless, because a reader who asked about s. 25 and is handed s. 5 cannot tell whether s. 25 was ever opened at all.

This happened in two production chats, four turns running. It is worth explaining why, because the cause was not the model being careless.

The cause

A research worker was sent to read a chapter with a named provision to look at. The chapter was small enough to hand over whole, so it was — all 274,281 characters of it, beginning at the long title. The named provision was quietly demoted to a label.

What the worker then quoted was whatever it could ground near the top of what it had been given. In most ordinances the first operative section is s. 5. So the failure was not random: it was a standing bias away from the section you asked about and towards an early one.

Then the second half of the failure. The named provision was in the record — it had been verified. Nothing required the answer to use it, and the weight of the record decided the shape of the answer: a large body of case law about s. 5 crowded out the provision the question named.

The two rules

The provision travels separately. Whichever way a document is opened, the provision named in the question is resolved first and comes back as its own short passage, with its label and its position. Quoting a fifteen-word clause out of a short span is a different task from finding it in a quarter of a million characters, and only one of them is reliable when the worker is a small, cheap model. A section label the chapter does not have now fails loudly, naming the shape of a real label, instead of quietly handing back page one.

The named provision must survive into the answer. If the question names a provision and that provision was verified, the answer is required to cite it. Not mentioned somewhere — cited, and answered first: what it does, what it does not do, and only then where the operative rule actually sits if it sits next door.

If nothing about the named provision could be verified, the rule yields rather than blocking the answer. The requirement is that a verified answer to your question cannot be silently displaced by a better-evidenced answer to a different one.

Why prompts did not fix this

Four of the six defects behind this failure were prompt lines added to cure an earlier version of it: not against a section number in a search hit, you will see the rest of the chapter anyway, the operative power may sit next door. Each was reasonable. Each was followed most of the time.

Most of the time is not a guarantee, and legal research needs guarantees. So the rule moved out of the prompt and into the program, where it either holds or throws an error someone has to look at.

Prose does not govern. Code governs.

What this does not promise

The provision you named will be opened, quoted and answered. It does not follow that it is the provision that decides your matter — the operative rule may sit in a section you did not know to name, in subsidiary legislation, or in a case construing a word in it.

The library also holds the current consolidated text only. It cannot tell you what a provision said on the date your facts happened.

None of this is legal advice, creates a solicitor–client relationship, or replaces reading the authorities.