AI Solutions Architect

• Own the scoring rules applied to every observed answer, and keep them written down on the methodology page.
• Design how each measurement run is recorded so every citation traces back to the answer it came from.
• Turn research requirements into a measurement design the team can repeat on the next volume.
• Prepare the datasets and analysis deposited with each published research volume.
• Decide when a result is solid enough to publish and when a limitation has to be stated beside it.
• Review client measurement before findings reach the client.

• Five or more years of experience building production systems.
• Working depth in Python, system design and data pipelines.
• Hands on work evaluating large language model output.
• A piece of analysis or evaluation you shipped that someone else could rerun.
• Eligibility to work in the United States without visa sponsorship.

• Remote only, hiring in the United States. Relocation is allowed.
• Candidates provide their own equipment.
• US work authorization is required. Broadcastwell does not provide visa sponsorship and does not offer E-Verify participation or I-983 support.
• Management consultants, AI engineers, AI architects and specialists, and researchers.
• Hours are flexible within US time zones, and work is judged on output.

• Published figures can be recomputed by anyone from the deposited data and analysis code.
• The same question and engine pair scores the same way under the published rules on every run.
• Client findings rest on measurement that holds up when the client checks the receipts.

The method behind these measures is published on the methodology page.

$140k to $190k a year, full time, no equity. These are the bands as posted on Wellfound.

1. Every application is read by a person.
2. One conversation about the role and the method.
3. One paid sample task, where the role calls for it.

Want to see how we think before you talk to us? Read or join the discussion at exchange.broadcastwell.com/careers.

Taking part in the Exchange is optional. It is never required, it is never reviewed when we assess an application, and it does not affect your application in any way. If you want to point to something you wrote here, you may link it yourself, as you would any portfolio link.

Broadcastwell Launchpad offers free public learning and referrals you make on your own. Joining, declining, completing or leaving Launchpad, making referrals, generating revenue, or taking part in the Exchange does not affect any application, interview, paid assessment or hiring decision. Learning and referrals create no entitlement or priority for paid work.

What you send is kept for twelve months and used only to assess your application. See the privacy notice.