Federal and State Court Systems: How Precedent Works

Legal precedent works through a doctrine called stare decisis: when an appellate court decides a legal question in a published opinion, every lower court in the same hierarchy has to reach the same conclusion the next time that question comes up. The United States runs two parallel court hierarchies, one federal and one in each state, and a single ruling near the top of either can reset the law for millions of people. Understanding how legal precedent works means understanding which courts speak with binding authority, which courts have to listen, and the handful of doctrines that decide when a precedent sticks and when it gives way.

What Counts as Precedent

Not every court decision creates precedent. Trial courts resolve disputes between the parties in front of them, but their rulings do not bind other courts. Precedent is the product of appellate courts, which review whether the trial court applied the law correctly and issue written opinions explaining their reasoning. Those opinions are what future courts must follow.

Precedent comes in two flavors. Binding precedent flows downward through a single hierarchy and must be applied. A U.S. Supreme Court decision binds every federal and state court in the country. A federal Court of Appeals decision binds every U.S. District Court within that circuit, so a district judge in Texas is bound by rulings of the Fifth Circuit, which covers Texas, Louisiana, and Mississippi.1United States Department of Justice. Introduction to the Federal Court System That judge cannot ignore a Fifth Circuit ruling just because they find it unpersuasive.

Persuasive precedent is different. It comes from courts outside the hierarchy: another circuit, another state’s supreme court, a treatise. A judge may find it useful, but nothing requires them to follow it.

Even within a single appellate court, not every opinion carries weight. Federal appellate courts routinely designate opinions as “unpublished” or “non-precedential,” typically in cases where the law is well-settled. Under Federal Rule of Appellate Procedure 32.1, parties may cite these opinions, but they carry no binding force.2Legal Information Institute. Rule 32.1 Citing Judicial Dispositions The precedent-making power of an appellate court lives in its published opinions.

Cases of First Impression

Sometimes a court faces a legal question no court in its jurisdiction has ever answered. These are called cases of first impression, and they are the most direct form of precedent creation. With no controlling prior decision, judges look to legislative history, public policy, decisions from other jurisdictions that have addressed similar questions, and respected treatises. The resulting opinion becomes the first binding rule on that issue for every lower court in the jurisdiction, and it stays that way until a higher court says otherwise or the legislature intervenes.

The Two Hierarchies That Produce Precedent

Article III of the Constitution vests federal judicial power “in one supreme Court, and in such inferior Courts as the Congress may from time to time ordain and establish.”3Congress.gov. U.S. Constitution – Article III Each state, in turn, has its own constitution creating its own court system. The two hierarchies run side by side.

Both generally follow a three-tier structure. Trial courts at the bottom. Intermediate appellate courts in the middle. A court of last resort at the top. The federal system has 94 U.S. District Courts, with at least one in every state.4United States Courts. About U.S. District Courts Those districts are grouped into 12 regional circuits, each with a U.S. Court of Appeals, plus a thirteenth circuit with nationwide jurisdiction over specialized matters like patent cases.5United States Courts. About the U.S. Courts of Appeals The U.S. Supreme Court sits above them all.

Each state has its own version of this structure, with its own highest court serving as the final authority on that state’s laws and constitution. When a state’s supreme court interprets state law, that interpretation controls even if a federal court disagrees, so long as no federal question is at stake.

The judiciary’s authority to strike down conflicting legislation traces back to Marbury v. Madison in 1803, which established judicial review and confirmed that the Constitution is enforceable law that courts can apply against acts of the other branches.6Constitution Annotated. Marbury v. Madison and Judicial Review7Justia U.S. Supreme Court Center. Marbury v. Madison That is the ultimate source of a court’s power to make binding law in the first place.

Which Court’s Precedent Applies to Your Case

Before any court can create precedent that reaches you, it has to have jurisdiction over the kind of dispute you are in. Federal and state courts draw those lines very differently.

Federal courts are courts of limited jurisdiction. They can only hear cases that fit categories defined by the Constitution and federal statutes. The two main categories are federal question jurisdiction and diversity jurisdiction. Federal question jurisdiction covers any civil case “arising under the Constitution, laws, or treaties of the United States.”8Office of the Law Revision Counsel. 28 U.S. Code 1331 – Federal Question Diversity jurisdiction covers disputes between citizens of different states when the amount at stake exceeds $75,000.9Office of the Law Revision Counsel. 28 U.S. Code 1332 – Diversity of Citizenship; Amount in Controversy; Costs The point of diversity jurisdiction is to give a neutral forum where a party might worry about hometown bias in the other side’s state court.

State courts are courts of general jurisdiction. They can hear nearly any type of case and handle the overwhelming majority of legal disputes in the country, from criminal prosecutions to contract fights to family law. Anything that does not fall within federal jurisdiction, or that falls in an area of overlap, can proceed in state court.

Standing: Who Can Ask the Court to Rule

Jurisdiction is not enough on its own. Federal courts also require that the person bringing the case has “standing,” meaning they have a concrete stake in the outcome. Under Lujan v. Defenders of Wildlife, a plaintiff must show an actual injury, a causal link to the defendant’s conduct, and a reasonable likelihood that a favorable ruling will fix the problem.10Legal Information Institute. Overview of the Lujan Test The Constitution limits federal courts to real “cases” and “controversies,” so courts will not answer hypothetical questions.11Congress.gov. Article 3 Section 2 Clause 1 Standing matters for precedent because it determines which disputes ever reach a court with the power to make binding law.

How Federal and State Precedent Interact

Federal and state courts do not run in sealed silos. Several doctrines govern whose precedent controls when the two systems overlap.

The Erie Doctrine

When a federal court hears a case under diversity jurisdiction, it must apply state substantive law. This rule comes from the Supreme Court’s 1938 decision in Erie Railroad v. Tompkins, which held that federal courts sitting in diversity cannot create their own version of state law; they have to apply the law the way that state’s own courts would.12Constitution Annotated. State Law in Diversity Cases and the Erie Doctrine If the state’s highest court has ruled on an issue, federal courts are bound by that interpretation. If the state supreme court later reverses itself, federal courts follow the new rule going forward. State courts remain the final authority on state law, even when a case happens to be in federal court.

Independent State Constitutional Law

State supreme courts can interpret their own constitutions to provide broader protections than the U.S. Constitution requires. When a state court rests its decision on “adequate and independent state grounds,” the U.S. Supreme Court will not review it.13Legal Information Institute. Adequate and Independent State Grounds A state ground is “adequate” when it fully supports the judgment on its own, and “independent” when it does not depend on federal law. On those state questions, state precedent is beyond federal reach.

Abstention

Federal courts sometimes decline to exercise jurisdiction they have, out of respect for state authority. Under the Pullman doctrine, a federal court may pause while a state court resolves an underlying state-law question that could eliminate the need to reach a federal constitutional issue. Under the Younger doctrine, federal courts generally refuse to interfere with ongoing state criminal prosecutions brought in good faith, with narrow exceptions if the prosecution is retaliatory, the challenged law is clearly unconstitutional, or the state court cannot provide a fair hearing. These doctrines often give state courts the first opportunity to create precedent on issues where the two systems overlap.

From State Court to the U.S. Supreme Court

A case that starts in state court can reach the U.S. Supreme Court, but only on narrow terms. The losing party must first exhaust every appeal within the state system, including a final ruling from the state’s highest court. Only then can they petition the Supreme Court, and only if the case raises a substantial federal question. The Supreme Court has no power to review a state court’s interpretation of state law on its own terms.

How a Case Climbs to a Precedent-Setting Court

Precedent gets made only when a case reaches an appellate court that decides to publish an opinion resolving a legal question. Every step of that climb matters.

When an appellate court reviews a lower court’s decision, it can affirm, reverse, or vacate the ruling. An affirmance confirms the result but not necessarily the reasoning; the appellate court might reach the same outcome for different reasons, and its reasoning becomes the controlling law. A reversal flips the outcome. A vacatur wipes the lower court’s opinion off the books. Many cases end in a vacate-and-remand: the appellate court sends the case back with instructions to redo part of the analysis under the correct standard. Complex cases can produce affirmance on some issues, reversal on others, and remand on the rest. Each ruling generates precedent on whatever legal question the opinion addresses.

En Banc Rehearing

Most federal appeals are decided by a three-judge panel. When a panel decision conflicts with the circuit’s existing precedent, conflicts with a Supreme Court decision, conflicts with another circuit, or involves a question of exceptional importance, the full circuit can rehear the case “en banc” if a majority of the active judges vote in favor.14Legal Information Institute. Rule 40. Panel Rehearing; En Banc Determination En banc rulings carry particular weight because they represent the considered judgment of the entire circuit, and they reset the binding precedent for every district court below.

The Supreme Court’s Discretionary Docket

The Supreme Court’s docket is almost entirely discretionary. A losing party asks the Court to hear their case by filing a petition for a writ of certiorari, and the Court grants or denies without explanation. Only about one to five percent of petitions get accepted in a typical year, depending on whether the petition was filed by a paying party or by a prisoner proceeding without a lawyer.

The most powerful driver of a grant is a circuit split, meaning two or more Courts of Appeals have reached conflicting conclusions on the same federal question. A circuit split means federal law is being applied differently in different parts of the country, which offends the principle that a federal statute should mean the same thing everywhere. Resolving those conflicts is one of the Court’s core functions, though the number of unresolved splits far exceeds its capacity to address them all. Internally, the justices use the Rule of Four: at least four of the nine must vote to grant review. Once the Court agrees to hear a case, whatever it decides binds every court in the country.

How Courts Avoid or Reverse Precedent

Precedent is durable, but it is not a straitjacket. Courts have two main ways to deal with a prior ruling they think should not control.

Distinguishing

The everyday tool is distinguishing. When a judge thinks a prior decision should not apply, they identify meaningful factual or legal differences between the earlier case and the one in front of them, then conclude that the earlier rule was built for a different situation. The original precedent stays intact and binding on the facts it was designed for, but it loses its grip on the new set of facts. Distinguishing is why lawyers spend so much time arguing over which prior cases are truly “on point.”

Overruling

Only the Supreme Court can overrule its own precedent. Lower courts are stuck with it no matter what they think. And the Supreme Court takes that step sparingly, because the stability of law depends on the expectation that settled rules will stay settled. When the Court considers overruling a prior decision, it weighs several factors developed over decades of practice.15Constitution Annotated. Stare Decisis Factorsp>

  • Quality of the original reasoning
  • Whether the rule has proven workable for lower courts
  • Whether later case law has eroded the decision’s foundations
  • Whether shifts in society’s understanding of the underlying facts have undermined it
  • Reliance interests: whether people, businesses, or institutions have structured their conduct around the ruling

Reliance interests often prove decisive. The harder it would be to unwind decisions people made based on a ruling, the stronger the case for keeping it, even if the Court now thinks it was wrongly decided. The Court has historically been more willing to overturn precedent in constitutional cases than in statutory cases, because Congress can fix a statutory ruling by passing a new law, while constitutional rulings have no easy legislative fix.

The Supreme Court maintains an official table of its own overruled decisions.16Constitution Annotated. Table of Supreme Court Decisions Overruled by Subsequent Decisions Recent additions include Dobbs v. Jackson Women’s Health Organization (2022), which overruled Roe v. Wade and Planned Parenthood v. Casey on abortion rights, and Loper Bright Enterprises v. Raimondo (2024), which overruled Chevron v. Natural Resources Defense Council on judicial deference to agency interpretations of federal statutes. Each reversal reshaped an entire area of law overnight.

Precedent in Motion: Three Rulings That Rewrote the Rules

The mechanics are easiest to see in cases that actually made the climb.

In Gideon v. Wainwright (1963), Clarence Gideon was charged with a felony in Florida and asked the trial court to appoint a lawyer because he could not afford one. The court refused, because Florida law then provided free counsel only in death penalty cases. Gideon represented himself, lost, and petitioned the Supreme Court from his prison cell.17Library of Congress. Gideon v. Wainwright, 372 U.S. 335 The Court ruled unanimously that the right to counsel is fundamental to a fair trial and that the Fourteenth Amendment requires states to provide one to any felony defendant who cannot pay.18Justia U.S. Supreme Court Center. Gideon v. Wainwright, 372 U.S. 335 (1963) The decision explicitly overruled Betts v. Brady (1942), which had allowed states to deny appointed counsel in non-capital cases.

Brown v. Board of Education (1954) consolidated lawsuits filed on behalf of Black children denied admission to all-white public schools. A lower federal court had ruled against them, bound by the “separate but equal” doctrine of Plessy v. Ferguson.19Justia U.S. Supreme Court Center. Brown v. Board of Education of Topeka, 347 U.S. 483 (1954) The Supreme Court reversed unanimously, holding that “separate educational facilities are inherently unequal” and violated the Fourteenth Amendment’s Equal Protection Clause. State-level policies were the target, but only the Supreme Court had the authority to overturn the national precedent sustaining them.

Miranda v. Arizona (1966) consolidated four cases in which suspects confessed during police interrogation without being told of their constitutional rights.20United States Courts. Facts and Case Summary – Miranda v. Arizona The Court held that the Fifth Amendment’s protection against self-incrimination applies during custodial questioning, and that police must warn a suspect of the right to remain silent and the right to an attorney before any custodial interrogation. A confession obtained without the warning is inadmissible. The ruling created a uniform procedural safeguard for every police department and courtroom in the country.

Each case took the same path. A dispute that could have ended quietly in a trial court climbed the appellate ladder, exposed a gap or flaw in existing precedent, and produced a Supreme Court opinion that rewrote the rules for the entire nation. That is how the American court system, through stare decisis, jurisdiction, and appellate review, turns individual disputes into binding law.