Bump-and-run or chip: A three-person experiment and the limits of evidence

On a green in Brisbane, I once stood and watched an amateur golfer set his bag down, pull a 60-degree wedge from it, and hit a shot that flew high into the air, landed on the fringe, and rolled back down to his feet. He shook his head, put the club away, and told me calmly: "I know I should be using my hybrid, but I still like the feeling of the ball going up." That moment was not a mishit. It was a decision, and it was made before he touched the ball.

I bring this up because last week I read an instruction piece on GOLF.com that essentially asked whether the bump-and-run is really more reliable than a chip. The newsroom ran its own small experiment, and its conclusion sounded emphatic: yes, rolling the ball with a hybrid is more reliable. What made me stop was not the conclusion. What made me stop was what stood behind it.

The context of a three-person experiment

The experiment is described briefly. Three amateur golfers. Each hit ten shots from about ten yards off the edge of the green. Five shots with a hybrid, using a near-putting motion. The other five with a wedge, the traditional chip style. Thirty shots in total. The only measurement criterion: whether the ball finished inside a three-yard zone around the hole. For a ten-yard shot, a three-yard zone is fairly generous.

The results are presented neatly. The hybrid put six of fifteen shots in the target zone. The wedge put five of fifteen in. A difference of exactly one shot. The article calls that evidence that the hybrid is more reliable, then ties it to the old advice: give up your high-loft wedges, use a hybrid around the green, and this will save strokes in the long run.

I have watched the short game long enough to know that advice like this lives a long life. It belongs to the evergreen instruction genre, untethered to the tournament calendar, untethered to the season. It gets re-shared every time a new player looks to cut strokes around the green. And precisely because it lives so long, it deserves to be read more carefully, not less.

What the aggregate hides

I want to reconstruct the math behind the phrase "more reliable." For six out of fifteen, the ninety-five percent confidence interval spans roughly sixteen to sixty-eight percent. For five out of fifteen, it spans roughly twelve to sixty-two percent. These two intervals overlap almost entirely. In other words, the result is indistinguishable from a coin flip. A one-shot margin over fifteen attempts is not enough to say one method is more reliable than the other.

But the most interesting part is not the aggregate. It is what the aggregate conceals.

The hybrid produced exactly two out of five for every tester. Three players, three identical results. That uniformity sounds at first like a sign of stability. But when you separate the wedge results by player, the picture changes. The player using a 58-degree wedge scored three out of five. The player using a 54-degree scored two out of five. The player using a 60-degree scored zero out of five.

Put together player by player: the first, hybrid two, wedge three, the wedge won. The second, hybrid two, wedge two, a tie. The third, hybrid two, wedge zero, the hybrid won. Two of three players matched or beat the hybrid with a wedge. The entire hybrid advantage was produced by exactly one player and exactly one club: the 60-degree wedge.

That is the detail the article does not surface. And it changes how we read the whole experiment.

A variable that got swapped

There is a deeper design problem. The comparison is labeled bump-and-run versus chip. But in reality, it compares one hybrid against three wedges of different lofts, swung by three different people. The variable actually changing is not the method. It is loft, and possibly bounce as well.

The 60-degree wedge with zero out of five, including two shots that missed the putting surface entirely, suggests a loft-and-bounce effect rather than evidence that the bump-and-run motion is superior. A 60-degree wedge has little bounce and a thin sole, and it digs easily when the lie is not perfect. The article's own advice, to trade in the ultra-high lofts, is consistent with a loft explanation. But the article sells it as a victory of method.

There is a technical detail the piece skips. Since 2026, the groove rule from the USGA and The R&A has limited the spin generated from rough lies on certain wedges. That made high-loft clubs less predictable when the lie is not clean. This is a legitimate technical reason to distrust a 60-degree wedge in an amateur's hands. But it is an argument about equipment and conditions, not about motion. The article took an equipment argument and used it to reinforce a method claim.

The three-yard zone and what it cannot measure

Then there is the measurement. The experiment recorded only a binary variable: in the zone or not. No direction of the leave, no short-long dispersion, no actual proximity to the hole. A three-yard corridor for a ten-yard shot tells us nothing about whether a miss was short or long, left or right, or whether it landed in a difficult spot. The article writes that the wedge dispersion widened considerably, but it provides no number for the hybrid to compare against. The comparison is therefore one-sided: one side described in words, the other measured by a count.

I have spent many mornings standing behind greens watching chips come to rest, and what I learned is that distance to the hole was never the whole story. A ball sitting in a three-yard zone but on a downhill putt is not the same as a ball sitting in a three-yard zone on an uphill putt. Being in the zone does not equal saving strokes. That is why serious measurement systems like Strokes Gained Around the Green track actual proximity to the hole, rather than simply counting how often a ball falls inside a circle.

The first-time factor

One more point. All three testers were handling a hybrid around the green for the first time in their lives. That they reached parity with a familiar wedge on a first attempt can be read two ways. One, the hybrid truly is forgiving. Two, the putting motion is simply so easy that anyone reproduces it instantly. The article picks the first reading without acknowledging the ambiguity. For someone who already controls a 60-degree wedge, this result may not repeat.

None of the three testers is given a handicap index. The reader cannot tell whether this result applies to a thirty-handicap or a near-scratch player. That is a large gap, because greenside advice depends heavily on skill level. For a beginner, a simple motion is more forgiving than a high-loft finesse shot. For someone who already controls a 60-degree, that club is a weapon, not a burden.

To be fair, I want to set this experiment beside how professionals work. When a tour player wants to improve the short game, they do not hit fifteen shots. They hit hundreds, tracked by radar, logging every distance, repeating across many turf conditions. A three-person, thirty-shot, single-distance, single-session experiment cannot produce the kind of evidence that a claim like "more reliable" demands. The gap in scale between the two approaches is not double. It is a hundredfold.

There is a paradox in how the article presents itself. It invites the reader to trust data, but the data it offers is too thin to stand on its own. If the author had written: we tried it and found the hybrid easier to use for beginners, that would be an honest statement given the data. Instead, the article writes: the hybrid is more reliable, and it will save strokes in the long run. These two statements are very far apart in how much evidence they require.

What is actually reliable

This is where I want to be counter-intuitive responsibly. The temptation is to dismiss the whole article. I will not. Its core advice, to use a hybrid like a putter around the green, is a reasonable and low-risk default for mid-level recreational players on firm, flat turf. The putting motion uses little wrist, causes few injuries, and the hybrid's wide sole resists digging. For someone who has had wrist or elbow pain, it may be a friendlier option than a steep chip.

The problem is not the direction of the advice. The problem is the degree of certainty the article assigns to it. A tie is presented as a win. A three-person, thirty-shot, single-distance experiment that controls for neither lie, green speed, nor slope is called evidence. And what the article fails to teach is the most important part: when not to use the bump-and-run.

I recall a line I once wrote about a sprinter: people run with their legs, but they win with their breath. Here it is the same. The amateur swings with the club, but wins with the choice. A hybrid saves no one if they choose it in a situation that requires the ball to carry a bunker. A bump-and-run cannot fly over an obstacle. It does not suit soft greens, slow greens, uphill lies, or thick rough. Those are the situations the experiment never touched, and they are also the situations where a reader is most likely to go wrong after finishing the piece.

I want to be clearer about the situations the article does not test. The bump-and-run is weakest when the ball must carry an obstacle, whether a bunker, a mound, or thick rough. It is weak on soft or slow greens, because the ball needs to roll to do its work. It is weak on uphill lies, because a putting motion cannot generate enough force through the grass. It is weak when the green calls for a high, soft landing, for instance when the hole sits just beyond the near edge. In all these situations, a high-loft wedge remains the right choice, and a reader who has just absorbed the advice to use a hybrid may lose strokes.

The article contains not a single line about these situations. It teaches how to do it, not when not to. For greenside advice, the when-not matters as much as the when.

A marketing story told in an editorial voice

What is notable is that the article's core message, that a wide sole and low loft reduce the penalty for mishits, is in effect a marketing argument for the game-improvement club category, told in the voice of an independent newsroom. No brand is named. But the structure of the message is familiar: forgiving clubs beat refined technique. It is a message that benefits hybrid manufacturers, and it is delivered without a single advertising dollar.

I am not saying there is a conspiracy. I am saying that when a marketing trend and an editorial trend align, the line between them blurs. Over the next eighteen months, I would not be surprised to see more content carrying the message to use a hybrid around the green. That trend may well be right for the majority of recreational players. But it will be driven by both data and commercial interest, and readers should know that.

There is a low simmering tension between two worlds. One is the rigorous data culture, where every shot is tracked by systems like ShotLink, Strokes Gained is calculated, and actual proximity to the hole is measured. The other is mass instruction content, where a three-person experiment is called evidence. The article stands in the second world but borrows the language of the first: zones, counts, success rates. It is an increasingly common content style, using the vocabulary of measurement without the discipline of measurement.

I have watched this shift for years. When analytics culture spreads into the mass market, the language of analytics travels ahead of the method of analytics. People say data before they know how to collect data. That is why a piece like this has appeal: it gives the reader the feeling of being armed with evidence, when in fact they are only armed with a story.

Sport as a common language

There is a moment in the piece that makes me think of the loneliness of practice. Three men stand on an empty green, hit thirty balls, and count how many land in the zone. No spectators, no applause, only the sound of club on ball and ball rolling. An empty stadium, but the applause still rings in me. In that silence, a small experiment is born, and then dressed in the coat of evidence.

I am not against small experiments. I make my living telling sports stories, and I know that big discoveries often start from a small observation. But there is a distance between a hypothesis worth pursuing and a conclusion worth trusting. The article crossed that distance without enough data to bridge it.

What I carry away from reading it is not new advice. It is a way of reading. When an instruction piece says we tested it, I will ask: how many people, how many shots, how many variables changed at once. When an article says the data proves it, I will ask: is that data distinguishable from randomness. These questions do not make me a worse golfer. They make me a closer reader.

And the man in Brisbane with the 60-degree wedge in his hand? He still likes the feeling of the ball going up. And if he is willing to learn when to put that club away, he will not need any experiment to convince himself.

Exhaustion is not a stopping point, but a crossroads where we choose the next road. For the recreational golfer around the green, that crossroads is not about choosing a hybrid or a wedge. It is about understanding the turf under your feet before you pull a club from the bag.