New Features​

Audit Tags (Labels) in PowerBI​

You can now filter and group audits by their labels in PowerBI. We've added a new audits_tags table that works just like the existing tickets_tags table - each audit's labels are stored as separate rows, making it easy to build reports around audit categorization.

-- Get audits with their labels
SELECT a.id, a.name, a.status, GROUP_CONCAT(at.tag SEPARATOR ', ') AS tags
FROM audits a
LEFT JOIN audits_tags at ON a.id = at.auditid
WHERE a.projectid = 'your_project_id'
GROUP BY a.id;

-- Filter audits by a specific label
SELECT a.id, a.name, a.status, a.dueDate
FROM audits a
JOIN audits_tags at ON a.id = at.auditid
WHERE at.tag = 'QC Inspection'
  AND a.archived IS NULL;

In PowerBI, create a relationship from audits.id to audits_tags.auditid and you're good to go.

Dataset Statistics Dashboard​

The dataset details screen now shows a statistics overview with counts for projects, audits, tickets, users, and contracts. Activity bars show updates from the last 24 hours and last 7 days, giving you a quick health check of each dataset.

Full & Incremental Sync Controls​

We've split the sync functionality into two clear modes:

• Incremental Sync: Fetches only data that changed since the last sync - fast and efficient for regular updates.
• Full Sync: Re-downloads all data from scratch - useful when you need a complete refresh.

Both the UI and API now support these modes separately, and timestamps for each sync type are tracked and displayed.

Reindex Progress Tracking​

Long-running reindex operations no longer leave you guessing. A real-time progress bar shows which data type is being processed, with phase information and a last-updated timestamp. This also fixes the timeout errors that could occur during large reindex operations.

Reindex History & Logs​

Every reindex operation is now logged with timestamps, status, and any warnings or errors. The history is visible on the dataset details page with color-coded entries, and logs are automatically cleaned up after 14 days.

Test Connection Button​

A "Test Connection" button on the dataset details page lets you verify that the MariaDB database is accessible - complete with a confetti animation when it succeeds.

Glacier Change Detection​

Projects that have been archived for over 6 months are moved to "glacier" storage in Ed Controls and disappear from Elasticsearch. We now automatically detect when these projects become available again (de-glaciered) and trigger a full reindex to bring the data back. A daily check keeps datasets in sync with project availability.

Contract Cleanup​

A new automated job checks all contracts in datasets against CouchDB and removes references to contracts that have been deleted. This prevents 404 errors and keeps datasets accurate. The job supports dry-run mode for safe testing.

Frontend Improvements​

Redesigned UI with EdControls Branding​

The entire frontend has been redesigned with the EdControls brand identity:

• Dark slate blue sidebar with the EdControls logo
• Stats cards and card-based layouts on the dashboard
• Status badges and improved pagination
• DM Sans font and smooth animations

Redesigned Documentation Site​

The documentation site also received a full makeover with the EdControls design system, including a new homepage with a SQL code preview terminal, feature cards, and quick links.

Quality of Life Improvements​

• Relative timestamps ("5 min ago", "2h ago", "Yesterday") for sync dates
• Removed placeholder icons that had no functionality
• Fixed navigation links, dataset save/refresh behavior, and contract removal updates

Reliability & Bug Fixes​

• Fixed incremental reindex dropping databases: A critical bug where incremental reindexes could wipe an entire database has been resolved. Only full reindexes or first-time setups will drop and recreate databases now.
• Fixed stale database connections: MariaDB connections that went idle for 8+ hours now automatically reconnect instead of failing.
• Prevented duplicate roles: Unique constraints on audit_roles, tickets_roles, and project_participants prevent duplicate entries from source data.
• Stale job recovery: Interrupted reindex jobs are now automatically detected on server restart and can be retried by the scheduled update job.
• SQL identifier escaping: Database names and usernames with special characters (like dots) are now properly escaped.
• Empty dataset handling: Datasets with no projects or no users are now handled gracefully instead of failing.

Technical Updates​

• Next.js upgraded to 16.1.6 and Clerk authentication to 6.36.10
• Docusaurus upgraded to 3.9.2 with Node.js 20 support
• OAuth authentication added for secure CouchDB API access
• Improved CLI tooling with --full and --type flags for reindex.py

All features are available now. For questions or support, contact us at support@edcontrols.com

🎯 What Are Progress Labels?​

Progress labels are sub-status indicators that provide granular visibility into where tickets stand in your workflow. While the main ticket status shows broad categories, progress labels reveal the specific stage of work within those statuses.

🚀 New Data Available in PowerBI​

Progress Labels Export​

We've added a new tickets_progress_labels table that stores progress markers for each ticket, linked via ticketid. This enables you to:

• Track workflow stages beyond basic open/closed status
• Identify bottlenecks in your ticket processing pipeline
• Monitor progress patterns across different ticket types
• Create detailed progress dashboards for stakeholders

Example Progress Label Values​

Based on the screenshot, common progress labels include:

• In behandeling (In progress)
• Klaar voor controle (Ready for review)
• Goedgekeurd (Approved)
• Wijzigingen aangevraagd (Changes requested)
• In de wacht (On hold)

📊 PowerBI Dashboard Opportunities​

For PowerBI Consultants​

This new data field opens up exciting dashboard possibilities:

-- Get ticket distribution by progress labels
SELECT 
    tpl.progress_label,
    COUNT(*) as ticket_count,
    AVG(DATEDIFF(day, t.creationdate, NOW())) as avg_days_in_status
FROM tickets t
JOIN tickets_progress_labels tpl ON t.id = tpl.ticketid
GROUP BY tpl.progress_label

For Ed Controls Users​

Create comprehensive progress tracking dashboards:

• Progress Distribution Charts: Visualize how tickets are distributed across different progress stages
• Workflow Bottleneck Analysis: Identify where tickets spend the most time
• Team Performance Metrics: Track how quickly tickets move through progress stages
• Historical Progress Trends: Monitor progress label changes over time

🔧 Implementation Examples​

Progress Overview Dashboard​

-- Tickets by progress label with time tracking
SELECT 
    t.title,
    t.status,
    tpl.progress_label,
    t.responsible as assignee,
    DATEDIFF(day, t.lastmodifieddate, NOW()) as days_in_current_progress
FROM tickets t
JOIN tickets_progress_labels tpl ON t.id = tpl.ticketid
ORDER BY days_in_current_progress DESC

Progress Transition Analysis​

-- Analyze progress patterns
SELECT 
    tpl.progress_label,
    t.status,
    COUNT(*) as count,
    AVG(DATEDIFF(day, t.creationdate, t.lastmodifieddate)) as avg_resolution_time
FROM tickets t
JOIN tickets_progress_labels tpl ON t.id = tpl.ticketid
GROUP BY tpl.progress_label, t.status

📈 Dashboard Use Cases​

Project Managers​

• Monitor ticket progress across teams
• Identify workflow bottlenecks
• Track time spent in each progress stage

Team Leads​

• Visualize team workload distribution
• Monitor review and approval queues
• Track progress label transitions

Stakeholders​

• High-level progress visibility
• Workflow efficiency metrics
• Progress trend analysis

🎯 Getting Started​

The tickets_progress_labels table is now automatically included in your dataset exports. Simply refresh your PowerBI dataset to start using progress labels in your reports and dashboards.

Quick Start Tips:​

1. Join progress labels with ticket data using ticketid for enhanced visibility
2. Create progress distribution visualizations to identify workflow patterns
3. Build time-in-stage metrics to optimize your processes
4. Set up progress-based alerts for tickets stuck in specific stages

💡 Pro Tips for Dashboard Builders​

• Combine with existing status fields for comprehensive workflow tracking
• Use progress labels for drill-down functionality in your dashboards
• Create progress transition matrices to visualize workflow paths
• Monitor progress label frequency to optimize your workflow stages

The progressLabels feature is available now in all datasets. For technical questions or dashboard implementation support, contact us at support@edcontrols.com

🎯 Audit Template Status Filtering​

Why We Added This Feature​

We've added the ability to filter out draft audit templates to ensure you're only working with published, finalized templates in your reports. This prevents confusion and ensures data quality by separating draft content from production-ready templates.

What Changed​

• New Column Added: All audittemplates tables now include a status column
• Values: 'published' or 'draft'

How to Filter Out Draft Templates​

To exclude draft templates from your PowerBI reports, use this filter in your queries:

SELECT * FROM audittemplates
WHERE status = 'published'

Or to exclude drafts specifically:

SELECT * FROM audittemplates
WHERE status != 'draft'

🔧 Ticket Custom Fields​

Why We Added This Feature​

This functionality was recently added to Ed Controls to support custom fields with tickets, allowing you to capture and analyze additional ticket metadata specific to your organization's needs.

Database Structure​

We've created three new tables for each dataset to support flexible custom field functionality:

1. tickets_custom_fields (Main table)

   • ticketid, field_id, field_label, field_type, field_value
   • Stores the primary custom field data and values

2. tickets_custom_field_options (Choice options)

   • ticketid, field_id, option_id, option_text, option_image
   • Stores available options for dropdown/choice fields

3. tickets_custom_field_selections (Selected choices)

   • ticketid, field_id, selected_option_id
   • Tracks which options were selected for multi-choice fields

Field Types Supported​

• freetext: Free text input
• numeric: Numeric values
• date: Date values
• singleSelectMultipleChoice: Single selection dropdowns
• multiSelectMultipleChoice: Multiple selection checkboxes

Example Queries for Custom Fields​

Get all custom fields for a ticket:

SELECT field_label, field_type, field_value
FROM tickets_custom_fields
WHERE ticketid = 'your_ticket_id'

Get tickets with specific custom field values:

SELECT t.title, tcf.field_label, tcf.field_value
FROM tickets t
JOIN tickets_custom_fields tcf ON t.id = tcf.ticketid
WHERE tcf.field_label = 'Priority' AND tcf.field_value = 'High'

For choice fields with options:

SELECT
    tcf.field_label,
    tcf.field_value,
    tcfo.option_text
FROM tickets_custom_fields tcf
LEFT JOIN tickets_custom_field_options tcfo
    ON tcf.ticketid = tcfo.ticketid AND tcf.field_id = tcfo.field_id
WHERE tcf.field_type IN ('singleSelectMultipleChoice', 'multiSelectMultipleChoice')

🚀 Getting Started​

These features are automatically available in your datasets. If you need assistance implementing these filters in your PowerBI reports or have questions about the new schema, please don't hesitate to reach out to our support team.

For technical questions or support, contact us at support@edcontrols.com