[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M78BX389CY9CS89AW6RG4F9Q":3,"skill-same:01M78BX389CY9CS89AW6RG4F9Q":46},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":25,"commitSha":26,"skillDirectory":27,"forksCount":14,"repositoryHtmlUrl":28,"repositoryHomepageUrl":29,"ownerHtmlUrl":30,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":31,"install":32,"resources":45},"01M78BX389CY9CS89AW6RG4F9Q","django-celery",null,"Django + Celery async task patterns — configuration, task design, beat scheduling, retries, canvas workflows, monitoring, and testing. Use when adding background jobs, scheduled tasks, or async processing to a Django app.","princepatel04477-web\u002Ftrivoxa-group","princepatel04477-web","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F227740714?v=4","01M788ZAJ2KECD5KXVP55PZXKS","Prince Patel","01M788ZAJTCN8YSD737MRSKC5Q",0,"MIT","https:\u002F\u002Fgithub.com\u002Fprincepatel04477-web\u002Ftrivoxa-group\u002Fblob\u002Fmaster\u002F.github\u002Fskills\u002Fdjango-celery\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: django-celery\ndescription: Django + Celery async task patterns — configuration, task design, beat scheduling, retries, canvas workflows, monitoring, and testing. Use when adding background jobs, scheduled tasks, or async processing to a Django app.\norigin: ECC\n---\n\n# Django + Celery Async Task Patterns\n\nProduction-grade patterns for background task processing in Django using Celery with Redis or RabbitMQ.\n\n## When to Activate\n\n- Adding background jobs or async processing to a Django app\n- Implementing periodic\u002Fscheduled tasks\n- Offloading slow operations (email, PDF generation, API calls) from request cycle\n- Setting up Celery Beat for cron-like scheduling\n- Debugging task failures, retries, or queue backlogs\n- Writing tests for Celery tasks\n\n## Project Setup\n\n### Installation\n\n```bash\npip install celery[redis] django-celery-results django-celery-beat\n```\n\n### `celery.py` — App Entrypoint\n\n```python\n# config\u002Fcelery.py\nimport os\nfrom celery import Celery\n\nos.environ.setdefault('DJANGO_SETTINGS_MODULE', 'config.settings.development')\n\napp = Celery('myproject')\napp.config_from_object('django.conf:settings', namespace='CELERY')\napp.autodiscover_tasks()  # Discovers tasks.py in each INSTALLED_APP\n\n@app.task(bind=True, ignore_result=True)\ndef debug_task(self):\n    print(f'Request: {self.request!r}')\n```\n\n```python\n# config\u002F__init__.py\nfrom .celery import app as celery_app\n\n__all__ = ('celery_app',)\n```\n\n### Django Settings\n\n```python\n# config\u002Fsettings\u002Fbase.py\n\n# Broker (Redis recommended for production)\nCELERY_BROKER_URL = env('CELERY_BROKER_URL', default='redis:\u002F\u002Flocalhost:6379\u002F0')\nCELERY_RESULT_BACKEND = env('CELERY_RESULT_BACKEND', default='django-db')\n\n# Serialization\nCELERY_ACCEPT_CONTENT = ['json']\nCELERY_TASK_SERIALIZER = 'json'\nCELERY_RESULT_SERIALIZER = 'json'\n\n# Task behavior\nCELERY_TASK_TRACK_STARTED = True\nCELERY_TASK_TIME_LIMIT = 30 * 60        # Hard limit: 30 min\nCELERY_TASK_SOFT_TIME_LIMIT = 25 * 60   # Soft limit: sends SoftTimeLimitExceeded\nCELERY_WORKER_PREFETCH_MULTIPLIER = 1   # Prevent worker hoarding long tasks\nCELERY_TASK_ACKS_LATE = True            # Re-queue on worker crash\n\n# Result persistence\nCELERY_RESULT_EXPIRES = 60 * 60 * 24   # Keep results 24 hours\n\n# Beat scheduler (for periodic tasks)\nCELERY_BEAT_SCHEDULER = 'django_celery_beat.schedulers:DatabaseScheduler'\n\n# Installed apps\nINSTALLED_APPS += [\n    'django_celery_results',\n    'django_celery_beat',\n]\n```\n\n### Running Workers\n\n```bash\n# Start worker (development)\ncelery -A config worker --loglevel=info\n\n# Start beat scheduler (periodic tasks)\ncelery -A config beat --loglevel=info --scheduler django_celery_beat.schedulers:DatabaseScheduler\n\n# Combined worker + beat (dev only, never production)\ncelery -A config worker --beat --loglevel=info\n\n# Production: multiple workers with concurrency\ncelery -A config worker --loglevel=warning --concurrency=4 -Q default,high_priority\n```\n\n## Task Design Patterns\n\n### Basic Task\n\n```python\n# apps\u002Fnotifications\u002Ftasks.py\nfrom celery import shared_task\nimport logging\n\nlogger = logging.getLogger(__name__)\n\n@shared_task(name='notifications.send_welcome_email')\ndef send_welcome_email(user_id: int) -> None:\n    \"\"\"Send welcome email to newly registered user.\"\"\"\n    from apps.users.models import User\n    from apps.notifications.services import EmailService\n\n    try:\n        user = User.objects.get(pk=user_id)\n    except User.DoesNotExist:\n        logger.warning('send_welcome_email: user %s not found', user_id)\n        return  # Idempotent — do not raise, task already impossible to complete\n\n    EmailService.send_welcome(user)\n    logger.info('Welcome email sent to user %s', user_id)\n```\n\n### Retryable Task\n\n```python\n@shared_task(\n    bind=True,\n    name='integrations.sync_to_crm',\n    max_retries=5,\n    default_retry_delay=60,       # seconds before first retry\n    autoretry_for=(ConnectionError, TimeoutError),\n    retry_backoff=True,           # exponential backoff\n    retry_backoff_max=600,        # cap at 10 minutes\n    retry_jitter=True,            # randomise to avoid thundering herd\n)\ndef sync_contact_to_crm(self, contact_id: int) -> dict:\n    \"\"\"Sync contact to external CRM with retry on transient failures.\"\"\"\n    from apps.crm.services import CRMClient\n\n    try:\n        result = CRMClient().sync(contact_id)\n        return result\n    except CRMClient.RateLimitError as exc:\n        # Specific retry delay from response header\n        raise self.retry(exc=exc, countdown=int(exc.retry_after))\n```\n\n### Idempotent Task Pattern\n\nDesign tasks so they can safely run multiple times with the same inputs:\n\n```python\n@shared_task(name='orders.mark_shipped')\ndef mark_order_shipped(order_id: int, tracking_number: str) -> None:\n    \"\"\"Mark order as shipped — safe to run multiple times.\"\"\"\n    from apps.orders.models import Order\n\n    updated = Order.objects.filter(\n        pk=order_id,\n        status=Order.Status.PROCESSING,    # Guard: only update if not already shipped\n    ).update(\n        status=Order.Status.SHIPPED,\n        tracking_number=tracking_number,\n    )\n\n    if not updated:\n        logger.info('mark_order_shipped: order %s already shipped or not found', order_id)\n```\n\n### Task with Soft Time Limit\n\n```python\nfrom celery.exceptions import SoftTimeLimitExceeded\n\n@shared_task(\n    bind=True,\n    name='reports.generate_pdf',\n    soft_time_limit=120,\n    time_limit=150,\n)\ndef generate_pdf_report(self, report_id: int) -> str:\n    \"\"\"Generate PDF report with graceful timeout handling.\"\"\"\n    from apps.reports.services import PDFGenerator\n\n    try:\n        path = PDFGenerator.build(report_id)\n        return path\n    except SoftTimeLimitExceeded:\n        # Clean up partial files before hard kill\n        PDFGenerator.cleanup(report_id)\n        raise\n```\n\n## Calling Tasks\n\n```python\nfrom datetime import timedelta\nfrom django.utils import timezone\n\n# Fire and forget (async)\nsend_welcome_email.delay(user.pk)\n\n# Schedule in the future\nsend_reminder.apply_async(args=[user.pk], countdown=3600)  # 1 hour from now\nsend_reminder.apply_async(args=[user.pk], eta=timezone.now() + timedelta(days=1))\n\n# Apply with queue routing\nsync_contact_to_crm.apply_async(args=[contact.pk], queue='high_priority')\n\n# Run synchronously (tests \u002F debugging only)\nresult = generate_pdf_report.apply(args=[report.pk])\n```\n\n## Beat Scheduling (Periodic Tasks)\n\n### Code-Defined Schedule\n\n```python\n# config\u002Fsettings\u002Fbase.py\nfrom celery.schedules import crontab\n\nCELERY_BEAT_SCHEDULE = {\n    'cleanup-expired-sessions': {\n        'task': 'users.cleanup_expired_sessions',\n        'schedule': crontab(hour=2, minute=0),   # 2am daily\n    },\n    'sync-inventory': {\n        'task': 'products.sync_inventory',\n        'schedule': 60.0,                         # every 60 seconds\n    },\n    'weekly-digest': {\n        'task': 'notifications.send_weekly_digest',\n        'schedule': crontab(day_of_week='monday', hour=8, minute=0),\n    },\n}\n```\n\n### Database-Defined Schedule (via django-celery-beat)\n\n```python\n# Manage periodic tasks from Django admin or code\nfrom django_celery_beat.models import PeriodicTask, CrontabSchedule\nimport json\n\nschedule, _ = CrontabSchedule.objects.get_or_create(\n    hour='*\u002F6', minute='0',\n    timezone='UTC',\n)\n\nPeriodicTask.objects.update_or_create(\n    name='Sync inventory every 6 hours',\n    defaults={\n        'crontab': schedule,\n        'task': 'products.sync_inventory',\n        'args': json.dumps([]),\n        'enabled': True,\n    }\n)\n```\n\n## Canvas: Chaining and Grouping Tasks\n\n```python\nfrom celery import chain, group, chord\n\n# Chain: run tasks sequentially, passing results\npipeline = chain(\n    fetch_data.s(source_id),\n    transform_data.s(),          # receives fetch_data result as first arg\n    load_to_warehouse.s(),\n)\npipeline.delay()\n\n# Group: run tasks in parallel\nparallel = group(\n    send_welcome_email.s(user_id)\n    for user_id in new_user_ids\n)\nparallel.delay()\n\n# Chord: parallel tasks + callback when all complete\nresult = chord(\n    group(process_chunk.s(chunk) for chunk in data_chunks),\n    aggregate_results.s(),       # called with list of chunk results\n)\nresult.delay()\n```\n\n## Error Handling and Dead Letter Queue\n\n```python\n# apps\u002Fcore\u002Ftasks.py\nfrom celery.signals import task_failure\n\n@task_failure.connect\ndef on_task_failure(sender, task_id, exception, args, kwargs, traceback, einfo, **kw):\n    \"\"\"Log all task failures to Sentry \u002F alerting.\"\"\"\n    import sentry_sdk\n    with sentry_sdk.new_scope() as scope:\n        scope.set_context('celery', {\n            'task': sender.name,\n            'task_id': task_id,\n            'args': args,\n            'kwargs': kwargs,\n        })\n        sentry_sdk.capture_exception(exception)\n```\n\n```python\n# Route failed tasks to dead-letter queue after max retries\n@shared_task(\n    bind=True,\n    max_retries=3,\n    name='payments.charge_card',\n)\ndef charge_card(self, order_id: int) -> None:\n    from apps.payments.models import Order, FailedCharge\n\n    try:\n        _do_charge(order_id)\n    except Exception as exc:\n        if self.request.retries >= self.max_retries:\n            # Persist to dead-letter table for manual review\n            FailedCharge.objects.create(\n                order_id=order_id,\n                error=str(exc),\n                task_id=self.request.id,\n            )\n            return  # Don't raise — task is permanently failed\n        raise self.retry(exc=exc)\n```\n\n## Testing Celery Tasks\n\n### Unit Testing (No Broker)\n\n```python\n# tests\u002Ftest_tasks.py\nimport pytest\nfrom unittest.mock import patch, MagicMock\nfrom apps.notifications.tasks import send_welcome_email\n\nclass TestSendWelcomeEmail:\n\n    @pytest.mark.django_db\n    def test_sends_email_to_existing_user(self, user):\n        with patch('apps.notifications.services.EmailService') as mock_email:\n            send_welcome_email(user.pk)\n            mock_email.send_welcome.assert_called_once_with(user)\n\n    @pytest.mark.django_db\n    def test_skips_missing_user_gracefully(self):\n        \"\"\"Should not raise when user is deleted between enqueue and execute.\"\"\"\n        send_welcome_email(99999)  # Non-existent user — must not raise\n```\n\n### Integration Testing with CELERY_TASK_ALWAYS_EAGER\n\n```python\n# config\u002Fsettings\u002Ftest.py\nCELERY_TASK_ALWAYS_EAGER = True      # Run tasks synchronously in tests\nCELERY_TASK_EAGER_PROPAGATES = True  # Re-raise exceptions from tasks\n\n# tests\u002Ftest_integration.py\n@pytest.mark.django_db\ndef test_registration_triggers_welcome_email(client):\n    with patch('apps.notifications.services.EmailService') as mock_email:\n        response = client.post('\u002Fapi\u002Fusers\u002F', {\n            'email': 'new@example.com',\n            'password': 'strongpass123',\n        })\n\n    assert response.status_code == 201\n    mock_email.send_welcome.assert_called_once()\n```\n\n### Testing Retries\n\n```python\n@pytest.mark.django_db\ndef test_task_retries_on_connection_error():\n    with patch('apps.crm.services.CRMClient.sync') as mock_sync:\n        mock_sync.side_effect = ConnectionError('timeout')\n\n        with pytest.raises(ConnectionError):\n            sync_contact_to_crm.apply(args=[1], throw=True)\n\n        assert mock_sync.call_count == 1  # First attempt only when eager\n```\n\n## Monitoring\n\n```bash\n# Inspect active workers and queues\ncelery -A config inspect active\ncelery -A config inspect stats\ncelery -A config inspect reserved\n\n# Check queue lengths (Redis)\nredis-cli llen celery\n\n# Flower: web-based real-time monitor\npip install flower\ncelery -A config flower --port=5555\n```\n\n## Anti-Patterns\n\n```python\n# BAD: Passing model instances — they may be stale by execution time\nsend_welcome_email.delay(user)        # Never pass ORM objects\nsend_welcome_email.delay(user.pk)     # Always pass PKs\n\n# BAD: Calling tasks synchronously in production views\nresult = generate_report.apply()      # Blocks the request thread\n\n# BAD: Non-idempotent task without guards\n@shared_task\ndef charge_and_fulfill(order_id):\n    order.charge()     # May charge twice if task retries!\n    order.fulfill()\n\n# GOOD: Idempotent with status guard\n@shared_task\ndef charge_and_fulfill(order_id):\n    order = Order.objects.select_for_update().get(pk=order_id)\n    if order.status != Order.Status.PENDING:\n        return  # Already processed\n    order.charge()\n    order.fulfill()\n```\n\n## Production Checklist\n\n| Check | Setting |\n|-------|---------|\n| Worker restarts on crash | `supervisord` or `systemd` unit |\n| `CELERY_TASK_ACKS_LATE = True` | Re-queue tasks on worker crash |\n| `CELERY_WORKER_PREFETCH_MULTIPLIER = 1` | Fair distribution of long tasks |\n| Separate queues per priority | `-Q default,high_priority,low_priority` |\n| `CELERY_TASK_SOFT_TIME_LIMIT` set | Graceful timeout before hard kill |\n| Sentry integration | Capture all `task_failure` signals |\n| Flower or other monitor | Visibility into queue depths |\n| Beat runs on single node only | Prevents duplicate scheduled task execution |\n\n## Related Skills\n\n- `django-patterns` — ORM, service layer, and project structure\n- `django-tdd` — Testing Django models, views, and services\n- `python-testing` — pytest configuration and fixtures\n","# Django + Celery Async Task Patterns\n\nProduction-grade patterns for background task processing in Django using Celery with Redis or RabbitMQ.\n\n## When to Activate\n\n- Adding background jobs or async processing to a Django app\n- Implementing periodic\u002Fscheduled tasks\n- Offloading slow operations (email, PDF generation, API calls) from request cycle\n- Setting up Celery Beat for cron-like scheduling\n- Debugging task failures, retries, or queue backlogs\n- Writing tests for Celery tasks\n\n## Project Setup\n\n### Installation\n\n```bash\npip install celery[redis] django-celery-results django-celery-beat\n```\n\n### `celery.py` — App Entrypoint\n\n```python\n# config\u002Fcelery.py\nimport os\nfrom celery import Celery\n\nos.environ.setdefault('DJANGO_SETTINGS_MODULE', 'config.settings.development')\n\napp = Celery('myproject')\napp.config_from_object('django.conf:settings', namespace='CELERY')\napp.autodiscover_tasks()  # Discovers tasks.py in each INSTALLED_APP\n\n@app.task(bind=True, ignore_result=True)\ndef debug_task(self):\n    print(f'Request: {self.request!r}')\n```\n\n```python\n# config\u002F__init__.py\nfrom .celery import app as celery_app\n\n__all__ = ('celery_app',)\n```\n\n### Django Settings\n\n```python\n# config\u002Fsettings\u002Fbase.py\n\n# Broker (Redis recommended for production)\nCELERY_BROKER_URL = env('CELERY_BROKER_URL', default='redis:\u002F\u002Flocalhost:6379\u002F0')\nCELERY_RESULT_BACKEND = env('CELERY_RESULT_BACKEND', default='django-db')\n\n# Serialization\nCELERY_ACCEPT_CONTENT = ['json']\nCELERY_TASK_SERIALIZER = 'json'\nCELERY_RESULT_SERIALIZER = 'json'\n\n# Task behavior\nCELERY_TASK_TRACK_STARTED = True\nCELERY_TASK_TIME_LIMIT = 30 * 60        # Hard limit: 30 min\nCELERY_TASK_SOFT_TIME_LIMIT = 25 * 60   # Soft limit: sends SoftTimeLimitExceeded\nCELERY_WORKER_PREFETCH_MULTIPLIER = 1   # Prevent worker hoarding long tasks\nCELERY_TASK_ACKS_LATE = True            # Re-queue on worker crash\n\n# Result persistence\nCELERY_RESULT_EXPIRES = 60 * 60 * 24   # Keep results 24 hours\n\n# Beat scheduler (for periodic tasks)\nCELERY_BEAT_SCHEDULER = 'django_celery_beat.schedulers:DatabaseScheduler'\n\n# Installed apps\nINSTALLED_APPS += [\n    'django_celery_results',\n    'django_celery_beat',\n]\n```\n\n### Running Workers\n\n```bash\n# Start worker (development)\ncelery -A config worker --loglevel=info\n\n# Start beat scheduler (periodic tasks)\ncelery -A config beat --loglevel=info --scheduler django_celery_beat.schedulers:DatabaseScheduler\n\n# Combined worker + beat (dev only, never production)\ncelery -A config worker --beat --loglevel=info\n\n# Production: multiple workers with concurrency\ncelery -A config worker --loglevel=warning --concurrency=4 -Q default,high_priority\n```\n\n## Task Design Patterns\n\n### Basic Task\n\n```python\n# apps\u002Fnotifications\u002Ftasks.py\nfrom celery import shared_task\nimport logging\n\nlogger = logging.getLogger(__name__)\n\n@shared_task(name='notifications.send_welcome_email')\ndef send_welcome_email(user_id: int) -> None:\n    \"\"\"Send welcome email to newly registered user.\"\"\"\n    from apps.users.models import User\n    from apps.notifications.services import EmailService\n\n    try:\n        user = User.objects.get(pk=user_id)\n    except User.DoesNotExist:\n        logger.warning('send_welcome_email: user %s not found', user_id)\n        return  # Idempotent — do not raise, task already impossible to complete\n\n    EmailService.send_welcome(user)\n    logger.info('Welcome email sent to user %s', user_id)\n```\n\n### Retryable Task\n\n```python\n@shared_task(\n    bind=True,\n    name='integrations.sync_to_crm',\n    max_retries=5,\n    default_retry_delay=60,       # seconds before first retry\n    autoretry_for=(ConnectionError, TimeoutError),\n    retry_backoff=True,           # exponential backoff\n    retry_backoff_max=600,        # cap at 10 minutes\n    retry_jitter=True,            # randomise to avoid thundering herd\n)\ndef sync_contact_to_crm(self, contact_id: int) -> dict:\n    \"\"\"Sync contact to external CRM with retry on transient failures.\"\"\"\n    from apps.crm.services import CRMClient\n\n    try:\n        result = CRMClient().sync(contact_id)\n        return result\n    except CRMClient.RateLimitError as exc:\n        # Specific retry delay from response header\n        raise self.retry(exc=exc, countdown=int(exc.retry_after))\n```\n\n### Idempotent Task Pattern\n\nDesign tasks so they can safely run multiple times with the same inputs:\n\n```python\n@shared_task(name='orders.mark_shipped')\ndef mark_order_shipped(order_id: int, tracking_number: str) -> None:\n    \"\"\"Mark order as shipped — safe to run multiple times.\"\"\"\n    from apps.orders.models import Order\n\n    updated = Order.objects.filter(\n        pk=order_id,\n        status=Order.Status.PROCESSING,    # Guard: only update if not already shipped\n    ).update(\n        status=Order.Status.SHIPPED,\n        tracking_number=tracking_number,\n    )\n\n    if not updated:\n        logger.info('mark_order_shipped: order %s already shipped or not found', order_id)\n```\n\n### Task with Soft Time Limit\n\n```python\nfrom celery.exceptions import SoftTimeLimitExceeded\n\n@shared_task(\n    bind=True,\n    name='reports.generate_pdf',\n    soft_time_limit=120,\n    time_limit=150,\n)\ndef generate_pdf_report(self, report_id: int) -> str:\n    \"\"\"Generate PDF report with graceful timeout handling.\"\"\"\n    from apps.reports.services import PDFGenerator\n\n    try:\n        path = PDFGenerator.build(report_id)\n        return path\n    except SoftTimeLimitExceeded:\n        # Clean up partial files before hard kill\n        PDFGenerator.cleanup(report_id)\n        raise\n```\n\n## Calling Tasks\n\n```python\nfrom datetime import timedelta\nfrom django.utils import timezone\n\n# Fire and forget (async)\nsend_welcome_email.delay(user.pk)\n\n# Schedule in the future\nsend_reminder.apply_async(args=[user.pk], countdown=3600)  # 1 hour from now\nsend_reminder.apply_async(args=[user.pk], eta=timezone.now() + timedelta(days=1))\n\n# Apply with queue routing\nsync_contact_to_crm.apply_async(args=[contact.pk], queue='high_priority')\n\n# Run synchronously (tests \u002F debugging only)\nresult = generate_pdf_report.apply(args=[report.pk])\n```\n\n## Beat Scheduling (Periodic Tasks)\n\n### Code-Defined Schedule\n\n```python\n# config\u002Fsettings\u002Fbase.py\nfrom celery.schedules import crontab\n\nCELERY_BEAT_SCHEDULE = {\n    'cleanup-expired-sessions': {\n        'task': 'users.cleanup_expired_sessions',\n        'schedule': crontab(hour=2, minute=0),   # 2am daily\n    },\n    'sync-inventory': {\n        'task': 'products.sync_inventory',\n        'schedule': 60.0,                         # every 60 seconds\n    },\n    'weekly-digest': {\n        'task': 'notifications.send_weekly_digest',\n        'schedule': crontab(day_of_week='monday', hour=8, minute=0),\n    },\n}\n```\n\n### Database-Defined Schedule (via django-celery-beat)\n\n```python\n# Manage periodic tasks from Django admin or code\nfrom django_celery_beat.models import PeriodicTask, CrontabSchedule\nimport json\n\nschedule, _ = CrontabSchedule.objects.get_or_create(\n    hour='*\u002F6', minute='0',\n    timezone='UTC',\n)\n\nPeriodicTask.objects.update_or_create(\n    name='Sync inventory every 6 hours',\n    defaults={\n        'crontab': schedule,\n        'task': 'products.sync_inventory',\n        'args': json.dumps([]),\n        'enabled': True,\n    }\n)\n```\n\n## Canvas: Chaining and Grouping Tasks\n\n```python\nfrom celery import chain, group, chord\n\n# Chain: run tasks sequentially, passing results\npipeline = chain(\n    fetch_data.s(source_id),\n    transform_data.s(),          # receives fetch_data result as first arg\n    load_to_warehouse.s(),\n)\npipeline.delay()\n\n# Group: run tasks in parallel\nparallel = group(\n    send_welcome_email.s(user_id)\n    for user_id in new_user_ids\n)\nparallel.delay()\n\n# Chord: parallel tasks + callback when all complete\nresult = chord(\n    group(process_chunk.s(chunk) for chunk in data_chunks),\n    aggregate_results.s(),       # called with list of chunk results\n)\nresult.delay()\n```\n\n## Error Handling and Dead Letter Queue\n\n```python\n# apps\u002Fcore\u002Ftasks.py\nfrom celery.signals import task_failure\n\n@task_failure.connect\ndef on_task_failure(sender, task_id, exception, args, kwargs, traceback, einfo, **kw):\n    \"\"\"Log all task failures to Sentry \u002F alerting.\"\"\"\n    import sentry_sdk\n    with sentry_sdk.new_scope() as scope:\n        scope.set_context('celery', {\n            'task': sender.name,\n            'task_id': task_id,\n            'args': args,\n            'kwargs': kwargs,\n        })\n        sentry_sdk.capture_exception(exception)\n```\n\n```python\n# Route failed tasks to dead-letter queue after max retries\n@shared_task(\n    bind=True,\n    max_retries=3,\n    name='payments.charge_card',\n)\ndef charge_card(self, order_id: int) -> None:\n    from apps.payments.models import Order, FailedCharge\n\n    try:\n        _do_charge(order_id)\n    except Exception as exc:\n        if self.request.retries >= self.max_retries:\n            # Persist to dead-letter table for manual review\n            FailedCharge.objects.create(\n                order_id=order_id,\n                error=str(exc),\n                task_id=self.request.id,\n            )\n            return  # Don't raise — task is permanently failed\n        raise self.retry(exc=exc)\n```\n\n## Testing Celery Tasks\n\n### Unit Testing (No Broker)\n\n```python\n# tests\u002Ftest_tasks.py\nimport pytest\nfrom unittest.mock import patch, MagicMock\nfrom apps.notifications.tasks import send_welcome_email\n\nclass TestSendWelcomeEmail:\n\n    @pytest.mark.django_db\n    def test_sends_email_to_existing_user(self, user):\n        with patch('apps.notifications.services.EmailService') as mock_email:\n            send_welcome_email(user.pk)\n            mock_email.send_welcome.assert_called_once_with(user)\n\n    @pytest.mark.django_db\n    def test_skips_missing_user_gracefully(self):\n        \"\"\"Should not raise when user is deleted between enqueue and execute.\"\"\"\n        send_welcome_email(99999)  # Non-existent user — must not raise\n```\n\n### Integration Testing with CELERY_TASK_ALWAYS_EAGER\n\n```python\n# config\u002Fsettings\u002Ftest.py\nCELERY_TASK_ALWAYS_EAGER = True      # Run tasks synchronously in tests\nCELERY_TASK_EAGER_PROPAGATES = True  # Re-raise exceptions from tasks\n\n# tests\u002Ftest_integration.py\n@pytest.mark.django_db\ndef test_registration_triggers_welcome_email(client):\n    with patch('apps.notifications.services.EmailService') as mock_email:\n        response = client.post('\u002Fapi\u002Fusers\u002F', {\n            'email': 'new@example.com',\n            'password': 'strongpass123',\n        })\n\n    assert response.status_code == 201\n    mock_email.send_welcome.assert_called_once()\n```\n\n### Testing Retries\n\n```python\n@pytest.mark.django_db\ndef test_task_retries_on_connection_error():\n    with patch('apps.crm.services.CRMClient.sync') as mock_sync:\n        mock_sync.side_effect = ConnectionError('timeout')\n\n        with pytest.raises(ConnectionError):\n            sync_contact_to_crm.apply(args=[1], throw=True)\n\n        assert mock_sync.call_count == 1  # First attempt only when eager\n```\n\n## Monitoring\n\n```bash\n# Inspect active workers and queues\ncelery -A config inspect active\ncelery -A config inspect stats\ncelery -A config inspect reserved\n\n# Check queue lengths (Redis)\nredis-cli llen celery\n\n# Flower: web-based real-time monitor\npip install flower\ncelery -A config flower --port=5555\n```\n\n## Anti-Patterns\n\n```python\n# BAD: Passing model instances — they may be stale by execution time\nsend_welcome_email.delay(user)        # Never pass ORM objects\nsend_welcome_email.delay(user.pk)     # Always pass PKs\n\n# BAD: Calling tasks synchronously in production views\nresult = generate_report.apply()      # Blocks the request thread\n\n# BAD: Non-idempotent task without guards\n@shared_task\ndef charge_and_fulfill(order_id):\n    order.charge()     # May charge twice if task retries!\n    order.fulfill()\n\n# GOOD: Idempotent with status guard\n@shared_task\ndef charge_and_fulfill(order_id):\n    order = Order.objects.select_for_update().get(pk=order_id)\n    if order.status != Order.Status.PENDING:\n        return  # Already processed\n    order.charge()\n    order.fulfill()\n```\n\n## Production Checklist\n\n| Check | Setting |\n|-------|---------|\n| Worker restarts on crash | `supervisord` or `systemd` unit |\n| `CELERY_TASK_ACKS_LATE = True` | Re-queue tasks on worker crash |\n| `CELERY_WORKER_PREFETCH_MULTIPLIER = 1` | Fair distribution of long tasks |\n| Separate queues per priority | `-Q default,high_priority,low_priority` |\n| `CELERY_TASK_SOFT_TIME_LIMIT` set | Graceful timeout before hard kill |\n| Sentry integration | Capture all `task_failure` signals |\n| Flower or other monitor | Visibility into queue depths |\n| Beat runs on single node only | Prevents duplicate scheduled task execution |\n\n## Related Skills\n\n- `django-patterns` — ORM, service layer, and project structure\n- `django-tdd` — Testing Django models, views, and services\n- `python-testing` — pytest configuration and fixtures\n",{"name":5,"origin":24,"description":7},"ECC","master","877653a671c51fae6476bd9f0d34ee6c408d68b9",".github\u002Fskills\u002Fdjango-celery","https:\u002F\u002Fgithub.com\u002Fprincepatel04477-web\u002Ftrivoxa-group","https:\u002F\u002Ftrivoxa-group.vercel.app","https:\u002F\u002Fgithub.com\u002Fprincepatel04477-web","2026-08-01 17:29:31",{"source":8,"skillName":5,"commands":33,"prompt":43,"zipAvailable":44},[34,37,40],{"tool":35,"command":36},"npx","npx skills add princepatel04477-web\u002Ftrivoxa-group --skill django-celery",{"tool":38,"command":39},"bunx","bunx skills add princepatel04477-web\u002Ftrivoxa-group --skill django-celery",{"tool":41,"command":42},"pnpm","pnpm dlx skills add princepatel04477-web\u002Ftrivoxa-group --skill django-celery","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fprincepatel04477-web\u002Ftrivoxa-group\u002Fblob\u002Fmaster\u002F.github\u002Fskills\u002Fdjango-celery\u002FSKILL.md",true,[],[47,54,61,68,75,82],{"skillNo":48,"name":49,"nameZh":6,"description":50,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":51,"categories":52,"keywords":53,"publishedAt":19},"01M78G4Z5RFJ72G536XYPC77PG","zustand-store-ts","Create Zustand stores following established patterns with proper TypeScript types and middleware.","https:\u002F\u002Fgithub.com\u002Fprincepatel04477-web\u002Ftrivoxa-group\u002Fblob\u002Fmaster\u002F.github\u002Fskills\u002Fzustand-store-ts\u002FSKILL.md",[],[],{"skillNo":55,"name":56,"nameZh":6,"description":57,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":58,"categories":59,"keywords":60,"publishedAt":19},"01M78G4WQMHRST36KDP7AV3NR3","zoom-automation","Automate Zoom meeting creation, management, recordings, webinars, and participant tracking via Rube MCP (Composio). Always search tools first for current schemas.","https:\u002F\u002Fgithub.com\u002Fprincepatel04477-web\u002Ftrivoxa-group\u002Fblob\u002Fmaster\u002F.github\u002Fskills\u002Fzoom-automation\u002FSKILL.md",[],[],{"skillNo":62,"name":63,"nameZh":6,"description":64,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":65,"categories":66,"keywords":67,"publishedAt":19},"01M78G4T37F4SPS7M4KT0A8JJB","zoho-crm-automation","Automate Zoho CRM tasks via Rube MCP (Composio): create\u002Fupdate records, search contacts, manage leads, and convert leads. Always search tools first for current schemas.","https:\u002F\u002Fgithub.com\u002Fprincepatel04477-web\u002Ftrivoxa-group\u002Fblob\u002Fmaster\u002F.github\u002Fskills\u002Fzoho-crm-automation\u002FSKILL.md",[],[],{"skillNo":69,"name":70,"nameZh":6,"description":71,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":72,"categories":73,"keywords":74,"publishedAt":19},"01M78G4QAJMF71KD1G38MNDQYK","zod-validation-expert","Expert in Zod — TypeScript-first schema validation. Covers parsing, custom errors, refinements, type inference, and integration with React Hook Form, Next.js, and tRPC.","https:\u002F\u002Fgithub.com\u002Fprincepatel04477-web\u002Ftrivoxa-group\u002Fblob\u002Fmaster\u002F.github\u002Fskills\u002Fzod-validation-expert\u002FSKILL.md",[],[],{"skillNo":76,"name":77,"nameZh":6,"description":78,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":79,"categories":80,"keywords":81,"publishedAt":19},"01M78G4MS3WE96MH5P561KFY95","zipai-optimizer","Adaptive token optimizer: intelligent filtering, surgical output, ambiguity-first, context-window-aware, VCS-aware, MCP-aware.","https:\u002F\u002Fgithub.com\u002Fprincepatel04477-web\u002Ftrivoxa-group\u002Fblob\u002Fmaster\u002F.github\u002Fskills\u002Fzipai-optimizer\u002FSKILL.md",[],[],{"skillNo":83,"name":84,"nameZh":6,"description":85,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":86,"categories":87,"keywords":88,"publishedAt":19},"01M78G4GZ0T47C6929V9CVH1AK","zeroize-audit","Detects missing zeroization of sensitive data in source code and identifies zeroization removed by compiler optimizations, with assembly-level analysis, and control-flow verification. Use for auditing C\u002FC++\u002FRust code handling secrets, keys, passwords, or other sensitive data.","https:\u002F\u002Fgithub.com\u002Fprincepatel04477-web\u002Ftrivoxa-group\u002Fblob\u002Fmaster\u002F.github\u002Fskills\u002Fzeroize-audit\u002FSKILL.md",[],[]]