Back to home

OCAIS backend engineering

Pricing Data Pipeline

Software Engineer

January–February 2026

Contributed backend services for pricing data, computation, and historical snapshots, connecting FastAPI and PostgreSQL to Redis Streams workers.

OCAIS backend engineering
PythonFastAPIPostgreSQLRedis StreamsBackground jobs

THE BRIEF

What needed to be built.

Coordinate pricing updates and computation without losing visibility into jobs that fail or stop midway.

MY CONTRIBUTIONS

My contribution.

APIs & history

  • Implemented pricing API and history workflows backed by PostgreSQL.
  • Developed snapshot and backfill tooling for pricing records.

Workers & recovery

  • Built Redis Streams producers and consumer-group workers that acknowledge jobs after successful computation.
  • Kept failed jobs pending for retry and reclaimed idle messages from interrupted workers.

WHY THIS APPROACH

Separate accepting work from executing it. Consumer groups track pending messages, successful computation controls acknowledgement, and reclaiming idle work supports recovery after worker interruption.

THE RESULT

Retryable pricing computation with explicit pending-work recovery.

Built pricing APIs, queued computation, and snapshot and backfill tooling, with explicit pending states and recovery for interrupted workers.

Back to home

WHAT’S NEXT

Your toughest problem could be
my next favorite project.

Full-stack development · Cloud infrastructure · Workflow automation · Engineering leadership

Email Ninn