Build an Automated Biopython FASTA Cleanser and Langfuse Telemetry Monitor

Process multi-fasta uploads to detect contaminated reads, low complexity regions, and non-IUPAC bases. Track preprocessing latency and data drift using Langfuse operational telemetry.

Bioinformatics Pipeline Engineer

Stream FASTA records through Biopython SeqIO sequence parser.

Validate nucleotide characters against IUPAC standards and strip terminal adapter contamination.

Record pipeline latency, input sizes, and rejection rates into Langfuse traces.

Save sanitized sequences into an archive ready for downstream research pipelines.

Dashboard displaying processing metrics, invalid sequence alerts, and export options.

Generate synthetic multi-FASTA files with injected IUPAC anomalies, adapter dimers, and valid nucleotides. Starter examples below are synthetic. They are not downloaded records.

Biopython Uses Biopython's sequence parsing and alphabet validation facilities to inspect nucleotide strings.

langfuse, biopython, fastapi. Langfuse enables detailed operational trace tracking, error monitoring, and step-level latency visualization. Lightweight model for generating human-readable sequence error categorization prompts.

Submit runnable source, pinned dependencies, setup commands, a working interface, example outputs, and a recorded end-to-end demo. Include tests and an action log.

Accurately flags non-standard IUPAC characters in raw sequences.

Emits traces to Langfuse containing token count, character counts, and step latencies.

Provides clean sanitized FASTA outputs for valid records.

```json [ { "input": { "batch_id": "BATCH-01", "records": [ { "id": "read1", "seq": "ATCGGCTA" } ] }, "expected_output": { "batch_id": "BATCH-01", "passed_records": 1, "failed_records": 0, "langfuse_trace_logged": true } }, { "input": { "batch_id": "BATCH-02", "records": [ { "id": "read2", "seq": "ATC123Z$$" } ] }, "expected_output": { "batch_id": "BATCH-02", "passed_records": 0, "failed_records": 1, "error_reasons": [ "Invalid non-IUPAC characters" ], "langfuse_trace_logged": true } } ] ```

Standard pre-processing tool for FASTA files; completely devoid of protected health information. Use mock external writes. Require human review before any real deployment.