Loading jobs…
Loading jobs…
Schonfeld — New York New York
About The Role
Schonfeld Strategic Advisors is seeking an experienced AI Data Engineer to join our Data Engineering team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines that power SchonAI, our firm's internal AI platform. You will work at the intersection of data engineering and AI, ensuring that high-quality, timely, and relevant data flows seamlessly to our AI systems to support investment professionals across the firm.
Key Responsibilities
Data Pipeline Development Design and build scalable, reliable data pipelines to ingest, transform, and deliver structured and unstructured data to SchonAI using Prefect. Develop ETL/ELT processes for diverse data sources including market data, research documents, internal databases, and third-party APIs.
Requirements
Ensure data quality, consistency, and integrity across all pipelines. AI Data Infrastructure Build and maintain data infrastructure optimized for AI/ML workloads, including vector databases and semantic search systems. Design data schemas and storage solutions that support efficient retrieval and processing for LLM applications.
Implement data versioning, lineage tracking, and observability for AI training and inference pipelines. Optimize data delivery for low-latency AI interactions and high-throughput batch processing.
Integrate with existing firm systems including risk platforms, trading systems, portfolio management tools, and research databases.
Work closely with business stakeholders to prioritize data sources and pipeline enhancements. Data Governance & Security Implement appropriate data access controls, encryption, and compliance measures.
Monitor and maintain data pipeline performance, reliability, and cost efficiency. Document data flows, transformations, and dependencies.
for ML/AI systems, including experience with vector databases (Pinecone, Weaviate, Qdrant) and embedding pipelines Preferred Experience Experience building data pipelines for LLM applications or RAG (Retrieval Augmented Generation) systems Familiarity with financial data sources (market data, fundamental data, alternative data) Knowledge of data streaming technologies (Kafka, Kinesis, Pub/Sub) Experience of Analytics/Warehouse/OLAP DB (BigQ, SingleStore, RedShift, ClickHouse) Experience with containerization (Docker) and orchestration (Kubernetes) Understanding of MLOps practices and tools Experience with data quality frameworks (Great Expectations, Deequ) Professional Skills Bachelor's or Master's degree in Computer Science, Data Engineering, or related technical field Strong problem-solving skills and attention to detail Excellent communication skills with ability to translate technical concepts for non-technical stakeholders Experience working in fast-paced, collaborative environments Self-motivated with ability to manage multiple priorities
Required Qualifications
g.
Who We Are
Schonfeld is a global multi-manager hedge fund tha