About the Role
Join a small team to architect, build, and maintain the core of our high-scale web scraping engine, handling over 1 billion monthly requests. You'll directly influence our technology decisions while tackling complex, exciting challenges in browser automation, advanced proxy management, distributed computing, and scalable microservices architecture.
You are probably a good fit if:
- You are passoniate about engineering, dont like meetings, heaving management but rather code all day long and focus on your work
- You thrive in a lean team and take full end-to-end ownership of features, from design through production
- You’re happy to wear multiple hats, jumping between backend, DevOps, and tooling as needs evolve
- You treat “failure” as data to quickly rolling forward with fixes and extracting lessons from every incident
- You’re proactive about improving our codebase, adding tests, and raising the overall engineering bar
You are probably not good fit if:
- You want a cushy job where your lack of commitment goes unnoticed
- You need a large, hierarchical organization with dedicated managers, project owners, and rigid processes to keep you on track
- You rely on extensive onboarding, hand-holding, or detailed specifications rather than diving in and figuring things out yourself
- You expect frequent team meetings, status updates, and heavy coordination rather than autonomy to drive your own roadmap
Key Responsibilities
Core Engine Development
- Architect, develop, and optimize our Python-based distributed scraping engine
- Introspect, Profile the code and find potential bottleneck
- Strong ability in debugging and chasing higgs boson bug from production that arise only under load or specific setup
- Work on new features and the product development