Compliance & Data Engineer

San Francisco, California, United StatesHybridContractPosted 2 months ago

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Role summary

This hybrid, contract role in San Francisco focuses on building and implementing compliance and data engineering solutions. The engineer will develop real-time analytics pipelines, secure storage solutions (WORM, immutable logs), and blockchain-related systems (ZK-proofs, Ethereum anchoring). Key responsibilities include creating a modular compliance engine with KYC/AML/sanctions rules, integrating third-party screening APIs, automating Travel Rule compliance, designing data warehouse schemas, and generating regulatory reports for standards like PCI DSS and SOC 2. The role requires strong SQL, experience with columnar databases (ClickHouse) and data warehouses (Snowflake/BigQuery), Kafka stream processing, and knowledge of financial data privacy regulations (GDPR, CCPA).

Job Title: Compliance & Data Engineer

Location: San Francisco, CA (Hybrid)

Duration: Contract

Key Responsibilities

• Build real-time analytics pipelines processing 50K+ TPS from Kafka into ClickHouse

• Implement WORM audit storage on S3 with cryptographic integrity verification

• Build ZK-proof anchoring pipeline committing Merkle roots to public Ethereum

• Develop modular compliance engine with configurable KYC/AML/sanctions rules

• Integrate Chainalysis and Elliptic APIs for real-time transaction screening

• Build Travel Rule compliance automation for cross-border reporting

• Design Snowflake schemas for historical analytics and regulatory reporting

• Implement immutable logging with tamper-evident structures for SOC 2 / ISO 27001

• Build automated regulatory report generation for PCI DSS and SOC 2

• Develop Grafana dashboards with SLA violation alerting

• Implement data retention policies and DSAR workflows

• Translate regulatory requirements into automated system controls

Required Qualifications

• 6+ years data engineering, 2+ years in financial services or compliance

• Strong SQL with columnar DBs (ClickHouse, Druid, or similar)

• Snowflake or BigQuery for warehousing and analytics

• Apache Kafka stream processing and pipeline construction

• KYC/AML regulatory frameworks: BSA, OFAC, EU sanctions

• Immutable storage: WORM, append-only logs, cryptographic trails

• Blockchain data: Merkle trees, block explorers, on-chain analytics

• Grafana, Tableau, or Superset for dashboarding

• GDPR, CCPA, and financial data privacy regulations

• BS in CS, Data Engineering, or related field

Preferred Qualifications

• ZK-proof systems for audit/compliance applications

• Financial reporting standards and regulatory filings

• Chainalysis, Elliptic, or blockchain analytics platforms

• Fabric ledger data extraction and block parsing

• SOC 2 / PCI DSS audit evidence collection systems

• CAMS certification

Technical Skills Required

Category Skills

Analytics:
ClickHouse, Snowflake, Grafana, Prometheus, Dashboards

Streaming:
Apache Kafka, Kafka Streams/Connect, Event sourcing

Storage:
S3 WORM, RocksDB, CouchDB, Immutable logs

Compliance:
KYC/AML, Chainalysis, Elliptic, Travel Rule, Sanctions

Languages:
Python, SQL, Go, Shell scripting

Blockchain:
Merkle Trees, ZK-Proofs, Block parsing, Anchoring

Ready to apply?

You'll be redirected to PURVIEW's application page.