mobiniqow
a464e550c9
Full-stack implementation of the Cyberyan full-stack trial task. Backend (Django 5 / DRF) - Normalised PostgreSQL model (Profile, Company, School, Skill, Experience, Education) as the source of truth, with GIN + trigram indexes. - Self-healing CSV reader: the supplied export carries an injected watermark column, missing columns, rows split by broken quoting and a duplicated header. A signature-scored Needleman-Wunsch alignment reconstructs 284 clean records out of 336 physical rows; only 10 rows parse correctly without it. - Pluggable search layer (Strategy): Elasticsearch by default, PostgreSQL full-text search as a fallback selected by a single environment variable. - Keyword search with per-field boosts, fuzziness and phrase boosting, six faceted filters (OR within a filter, AND across filters), an experience range, four sort orders, highlighting and facet aggregations. - JWT auth with rotation + blacklist, three roles, PII masking, scoped rate limits, a single error envelope, OpenAPI schema and health probes. Frontend (React 18 / TypeScript / Vite) - Debounced search with type-ahead, faceted filter panel, result cards, profile drawer, URL-synced search state, automatic token refresh. - Highlight snippets rendered without dangerouslySetInnerHTML. Infrastructure - Hardened multi-stage images (non-root, read-only rootfs, healthchecks). - docker-compose for the full stack plus dev and production overlays. - ELK: structured JSON logs shipped asynchronously to Logstash, routed per event type, with a composable index template and a Kibana setup script. Quality - 61 backend tests (85% coverage), ruff/black/bandit/mypy, ESLint + tsc, GitHub Actions running lint, tests and both image builds. - Persian documentation: README plus architecture, search, API, data, security and operations guides. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GnFo6fNaHCTAkJbfcdkqtG
41 lines
1.4 KiB
Python
41 lines
1.4 KiB
Python
"""The index document must stay in sync with the mapping - and hide PII."""
|
|
|
|
from __future__ import annotations
|
|
|
|
import pytest
|
|
|
|
from apps.search.indexing import INDEX_MAPPINGS, build_document
|
|
|
|
pytestmark = pytest.mark.django_db
|
|
|
|
|
|
def test_document_only_contains_mapped_fields(sample_profiles) -> None: # noqa: ANN001
|
|
"""
|
|
The mapping is ``dynamic: strict``: an unmapped field makes Elasticsearch
|
|
reject the whole document, so this assertion protects every reindex.
|
|
"""
|
|
document = build_document(sample_profiles[0])
|
|
assert set(document) <= set(INDEX_MAPPINGS["properties"])
|
|
|
|
|
|
def test_document_never_carries_contact_details(sample_profiles) -> None: # noqa: ANN001
|
|
profile = sample_profiles[0]
|
|
profile.emails = [{"address": "sara@acme.com", "type": "professional"}]
|
|
profile.phone_numbers = ["+491701234567"]
|
|
profile.save(update_fields=["emails", "phone_numbers"])
|
|
|
|
document = build_document(profile)
|
|
serialised = str(document)
|
|
assert "emails" not in document
|
|
assert "phone_numbers" not in document
|
|
assert "sara@acme.com" not in serialised
|
|
assert "+491701234567" not in serialised
|
|
|
|
|
|
def test_document_denormalises_the_related_rows(sample_profiles) -> None: # noqa: ANN001
|
|
document = build_document(sample_profiles[0])
|
|
assert document["full_name"] == "sara python"
|
|
assert document["company"] == "acme corp"
|
|
assert "python" in document["skills"]
|
|
assert document["years_experience"] == 9
|