Field Briefs

Notes from the practice.

Short, opinionated field briefs on the patterns that have worked in production engagements. Architecture decisions, the four things to get right, the trade-offs we keep seeing.

8-Minute Read

WorkdaySchema DriftApache IcebergSparkAWS GlueAgentic AI

A field guide to auto-relationalization

Turning nested API exports — Workday, PeopleSoft, Salesforce — into a proper relational model, without rebuilding it by hand every release.

Most data teams treat nested-to-relational as a design problem — someone draws the target schema, someone else writes the mapping code. It is actually an extraction problem. The relational model is already in the export, encoded in the path structure of the source itself, and the work is not designing it. The work is reading it. Four moves that make the extraction reliable, three details that make it survive schema drift, and where AI starts paying off on top.

Read the brief

8-Minute Read

CI/CDGitRelease ManagementTrunk-Based DevAgentic AI

A field guide to selective promotion

How a large engineering team shares one development sandbox — and still ships any single feature to production, on any schedule.

Most release models quietly force a choice: integrate and test everything together and therefore ship it together, or ship features independently and never test them in the combination they will actually run in. There is a third option large engineering organizations eventually need — a shared sandbox for integrated testing plus selective per-feature promotion. Here is what makes it work, and the edge cases to design for deliberately.

Read the brief

7-Minute Read

S3LambdaEMRApache IcebergBedrockAgentic AI

A field guide to the lean data lake

Assembling S3, Lambda, EMR, and Iceberg into a production-grade lake — and the four things you have to get right.

Many teams reach for a managed lakehouse because they assume the alternative is operationally too heavy. In our experience running production lakes at scale, the opposite is true. A small set of primitives, assembled with the right discipline, produces a leaner, cheaper, more debuggable lake than any managed platform — and it leaves every AI exit ramp wide open.

Read the brief Download PDF

A Note

These briefs are written for the engineers and architects doing the work. They are not white papers, sales materials, or vendor talks. If a brief is useful for whatever your team is wrestling with this quarter, take it — no form, no ask attached.