As a Principal Architect, you will be responsible for the architectural design and end-to-end implementation of a high-performance OLAP query engine and semantic layer. The primary goal is to develop a custom JSON-based query language (DSL) and a translation engine that converts these requests into optimized SQL for columnar databases. This role requires a deep understanding of systems programming, compiler theory, and multi-dimensional data modeling to serve high-concurrency read loads in a microservices environment.
What You'll Do
Architectural Design & Query Execution
Compiler & DSL development: Design a custom JSON-based OLAP query language. Define eBNF grammars and build a translation layer to convert functional formulas and DSL requests into an optimized execution plan.
SQL generation & optimization: Implement and oversee the generation of highly optimized SQL tailored for columnar databases including ClickHouse, SingleStore, and DuckDB.
Semantic layer management: Architect the representation of multi-dimensional data models within columnar structures, ensuring efficient data retrieval and aggregation.
Custom function logic: Implement logic for custom functions, determining the optimal balance between SQL push-down and application-layer execution
Caching & Performance Engineering
Multi-dimensional caching: Envisage and implement a distributed caching strategy for multidimensional data, utilizing shared memory systems like Redis.
Concurrency & scaling: Build and maintain high-performance microservices using Java (Micronaut or Spring Boot) with Project Loom (Virtual Threads) to handle massive concurrent read loads.
Low-level optimization: Manage system-level performance including connection pooling, array pooling, and off-heap memory management.
JVM tuning: Apply expert knowledge of Java Garbage Collectors (including ZGC and Shenandoah) to maintain low-latency response times.
Engineering Excellence & AI Integration
AI-augmented development: Leverage AI coding agents and tools to accelerate the software development lifecycle, from prototyping to debugging.
Technical documentation: Maintain a disciplined approach to software development by documenting architectural decisions, design patterns, and technical specifications.
Technical leadership: Act as the primary technical authority on query engine internals, providing guidance on complex systems-level challenges.
What We're Looking For
15+ years in software engineering with a focus on backend systems and data infrastructure
Strong theoretical and practical knowledge of compilers, ASTs, eBNF, and query planning
In-depth understanding of SQL, query optimization, and the internal workings of columnar databases
Expert proficiency in Java, specifically regarding multi-threading, asynchronous I/O, networking, and memory management
Proven experience in designing distributed caching layers and managing state across microservices
Ability to decompose complex data problems into scalable architectural components
Clear verbal and written communication skills, with a strong tendency to document thoughts and architectural ideas
A rigorous approach to software craftsmanship, including testing, telemetry, and performance benchmarking
Minimum of 1 year of experience using AI coding agents to enhance development productivity
Prior experience developing financial systems such as ERP, EPM, or General Ledger platforms is an added plus
Why this Role
You will own the internals of the query engine at the heart of a next-generation financial planning platform — the layer where compiler theory, columnar database performance, and multi-dimensional semantics converge.
Why Planful
To foster the best in class work we’re so proud of, we’ve created a best in class culture, including:
2 Volunteer days per year, Birthday PTO, and quarterly company Wellness Days
3 months supply of diapers and meal deliveries for the first month of your Maternity/Paternity leave and generous parental leave
Talkspace access and mental health support
Annual company-wide gatherings held in cities like San Diego, Denver, Palm Springs, and Vegas!
Office hubs in San Francisco, Toronto, and London. We also offer benefits such as home office setup, and monthly wifi and cell phone reimbursements for all employees, in-office or remote.
Employee Resource Groups such as Women of Planful, Parents of Planful, and many more. We encourage our teammates to bring their authentic selves to the team, and have full support in creating new ERGs & communities along the way
... Supervision received is essentially administrative, with assignments given in terms of broad general objectives and limits. • Developing and implementing an architectural discipline equipped with up-to-date architectural and management tools, technical and managerial capability and operating procedures to successfully and ...
... technical risks, architecture trade-offs, and remediation priorities clearly to engineering leaders, product owners, auditors, and customer-facing teams. - Mentor architects and engineers on automotive cybersecurity, cloud security, secure design practices, and reusable architecture patterns. What You Need to Be Successful - Bachelor's ...
... inclusion, we are seeking driven individuals to join our fast-growing regional team as we push the boundaries of innovative fintech solutions. Job Description: Principal Architect, Payments & Ledger You'll own the architectural direction for money movement end to end: multi-currency wallets and balances, the core ledger, card ...
Principal Architect, Data & Analytics The role of Principal Architect, Data & Analytics, will play a pivotal role in strategic data & analytics initiatives. This role will lead a team of technical leads and engineers focused on tools and technologies such as Azure Synapse, PowerBI, Databricks, Azure Data Lake, and other ...
... open data ecosystem powered by AI, cloud and on-premises technologies. Clients around the world rely on NielsenIQ data and insights to innovate and grow. As a Principal Architect within the Enterprise Architecture team, you will define architecture for key components and capabilities across NIQ platforms, ensuring alignment ...
... open data ecosystem powered by AI, cloud and on-premises technologies. Clients around the world rely on NielsenIQ data and insights to innovate and grow. As a Principal Architect within the Enterprise Architecture team, you will define architecture for key components and capabilities across NIQ platforms, ensuring alignment ...
Principal Architect, Data Architecture and Design The Principal Technical Architect provides technical leadership for complex data and analytics solutions across multiple programs and business domains. This role is responsible for translating business strategy into scalable, secure, and maintainable technology solutions ...
Principal Architect - AI & Full Stack Experience: 8-12 years Location: Bangalore / Ahmedabad / Jodhpur Role Overview: We are looking for a strong hands-on, forward-thinking Technical pioneer who can split their time between two critical mandates: - 50% Solution Architecture & Client-Facing Technical Engagement– Architect ...
About the Opportunity:We are looking for an elite Principal Architect who is part visionary, part relentless full-stack executor to join our core team as a high-impact Individual Contributor (IC). This is not a role for someone who just wants to draw diagrams or pass off tickets. We are looking for a dynamic, high-spirited ...
... Skills & Experience:- 15 - 20 years of experience in software architecture, enterprise architecture, or large-scale digital engineering.- Proven experience as a Principal Architect, Enterprise Architect, Solution Architect, or equivalent senior architecture role.- Strong experience designing and modernizing digital commerce ...