The Job
We are hiring a Rust developer to help design and implement the database infrastructure for our observability platform, Pydantic Logfire.
Context
Pydantic is building a next-generation observability platform targeted at modern development teams that use AI, are multi-language, cloud-native and cost conscious.
We build on the shoulders of proven modern technologies such as OpenTelemetry, SQL / DataFusion, Postgres, Kubernetes, Object Storage, TypeScript, Rust and Python.
We're backed by Sequoia Capital and have long term runway.
Pydantic is a fully remote company with employees all over the world. We get together for offsites regularly - our next one is in May.
What you will do
You will join our small team of Rust experts making our database as efficient and reliable as possible. Some examples of things we work on:
- Optimize execution of query plans across distributed database hardware
- Use data from running Logfire in our own production to find and optimize bottlenecks and pathological cases
- Push forward a state of the art caching system for DataFusion
- Develop an incrementally refreshing materialized view system for DataFusion
- Maintain and improve ingestion pipelines for OpenTelemetry data
All of these technologies are built in Rust with a strong focus on performance and stability. There are frequently opportunities to contribute to upstream projects such as DataFusion and Arrow, we believe in open source and growing the community as we grow our company.
What we bring to the table
- Greenfield project — while already complex and in production our system is still very flexible and we regularly make large-scale changes with outsized impact
- Work with great people — we have a small team of 3 experienced Rust developers, including a PyO3 maintainer, and meet regularly with maintainers of the Arrow and DataFusion projects
- Fully remote — we're a remote-first company, we get together in person roughly once a quarter for a week — our next "offsite" will be in France in the first week of May
- Full benefits and competitive pay — we offer competitive salaries, equity no matter what country you are based out of
- Build developer tools — we dogfood our own product and you'll be using it every day - you can fix the things you don't like!
Technical Requirements
We're looking for (in descending order of importance):
- Deep experience with Rust and its ecosystem
- Experience with analytical/time-series database development and use — in particular we build upon the Apache Arrow ecosystem, and Apache DataFusion
- Experience working with observability tools — experience working for an observability company, using observability platforms, and knowledge of OpenTelemetry would all be highly valuable
- Experience working with Python and/or TypeScript would be a minor plus
More generally, you should care about performance, scalability, and developer experience, both within the team and for those using the tools we're building.
Non-technical Requirements
- Required: Live and work in a timezone between PT (UTC-8) and CET (UTC+1). This is a hard requirement, please do not apply if you do not meet this requirement.
- Required: Able to travel to EU, UK and US up to 4 times a year to join our off-sites
- Required: Fluent in English
- Required: Must be available to join on-call rotations, approximately 1 week out of every 10 (subject to change)
Apply
To apply, email [email protected].
No recruiters or agencies please, any contact from recruiters will be marked as spam.
Explore Logfire.
Explore our open source packages