Features

• Added capability for the dataset.read view function to "search" a package's resources via the URI arg resource_query. It only searches by the resource names.

  ^{Canada Fork Only}

  Changes

• The error message for duplicate DataStore column names will now display which supplied column names are the duplicated ones.

  ^{Canada Fork Only}

View it on GitHub [07da8c53a...ad50d0728]

 This repository is only tracked from upstream.

View it on GitHub [c18c62317...bedd91d1d]

  Features

• additional tests for contracts pd type

• Added a search field on the Dataset page to search for Resources by their name. This improves the UI/UX alongside the resource paging feature.

  Changes

• Added test coverage for DataStore column name errors from upstream PR#224

View it on GitHub [c0703d6d2...0535ad284]

  Changes

• Added the HTTP header CKAN/ to Frictionless requests when downloading data from file sources.

  ^{Canada Fork Only}

View it on GitHub [bccc5d6b1...d85c8bb95]

  Changes

• Explicitly log Database (and other) Exceptions in the delete_datastore_table view function via the datastore_delete action. This fixes an issue with ambiguous stacktraces only logging TypeError for view function return instead of the parent Exception.

  ^{Canada Fork Only}

• Added the HTTP header CKAN/ to Python requests when downloading data from file sources.

  ^{Canada Fork Only}

View it on GitHub [01db87288...540c59d3f]

  Releases

• Released the 6th National Action Plan schema under nap6.yaml definition.

  Changes

• Add nap6 to Makefile.

• Added more test coverage for ATI Summaries (ati and ati-nil)

• Added more test coverage for Briefing Note Titles and Numbers (briefingt and briefingt-nil)

• Added more test coverage for Departmental Audit Committee (dac)

• Added more test coverage for Position Reclassification (reclassification and reclassification-nil)

• Added more test coverage for Acts of Founded Wrongdoing (wrongdoing)

View it on GitHub [f7bf259f7...c0703d6d2]

  Changes

• • Allow users to request a password reset using a case-insensitive email address.
  • Ensures password reset works even if the email is stored with mixed-case letters in the database.
  ^{Canada Fork Only}

View it on GitHub [356ada3f9...07da8c53a]

 This repository is only tracked from upstream.

View it on GitHub [96410276f...c18c62317]

  Features

• Add pagination for resources displayed on the dataset page. This improves the page load time for very large datasets.

  Changes

• Test coverage added to allow users to recover their username using a case-insensitive email match. This ensures users can retrieve their username even if their email is stored with mixed-case letters in the database.

• Added missing gettext and French translation strings for the contact_information JSON field output.

• Update CDTS version to 5.0.5 which includes GCWEB 17.1.1 and WET-BOEW 4.0.89.

View it on GitHub [fcf55abb0...f7bf259f7]

  Bugfixes

• Backported d3fff92 to fix a flaky issue with resource uploads when updating.

  ^Backport

• Added an Order By to the backref resources_all so that the Package ORM object accessing its resources property will have the resources in the proper ordering of position. This fixes a flaky issue when uploading resources during package_update

  ^{Canada Fork Only}

  Changes

• Added a unique constraint con_package_resource_unique_position onto the Resource model to make resource positions unique per dataset. This is a deferrable constraint. Resource with a deleted state will now have null positions. Requires DB plugin migration.

  ^{Canada Fork Only}

View it on GitHub [acc01450d...356ada3f9]

  Features

• 500 Internal Server errors will now output a Support ID into the logs and on the error page for logged in users on the Registry.

  Changes

• Added test coverage and plugin migration (alembic version 015d2fdd075f) for the new Resource unique constraint con_package_resource_unique_position from PR#221

• Added test coverage for Resource uploads, namely the issue resolved in upstream PR#222

View it on GitHub [0a2cc40da...fcf55abb0]

 This repository is only tracked from upstream.

View it on GitHub [5204863bb...24cca0616]

  Changes

• Added a workaround to JavaScript render blocking that could prevent the PowerBI report from initializing properly. Added front-end console verbosity.

View it on GitHub [fc483d993...fedf0c4e4]

  Changes

• Worksheet names will now always be processed in lower case when uploading Excel files.

View it on GitHub [25044c17f...d99e6c9a9]

 This repository is only tracked from upstream.

View it on GitHub [f2de80a26...ca00e1101]

  Changes

• Created alembic migration 16ed91c52021 to fix an issue with Resource positions not being based on 0 index. This was due to older CKAN versions not updating the Resource poistions after deleting a Resource from the dataset.

• Remove validation of future agreement_start_date in grants template.

View it on GitHub [94317c72f...0a2cc40da]

  Features

• Added a available_package_types action to catch various fatal errors in Activity streams.

  ^{Canada Fork Only}

  Bugfixes

• Backported e8ec7fb to fix a major issue with Resource updating and patching in regards to the Resource ordering.

  ^Backport

• Fixed an issue with the Success and Failure flash messages not rendering properly in the resource-reorder JS module.

  ^{Canada Fork Only}

View it on GitHub [b250af221...acc01450d]

  Bugfixes

• Fixed an issue with some templates and chained actions assuming their parent plugins were loaded.

View it on GitHub [5831a15fe...94317c72f]

  Features

• Added a ckan.site_read_only config option which disables actions causing side effects, such as *_create, *_update, and *_delete, for non-sysadmin users.

  This setting does not prevent updates to the database from sysadmin users or updates that skip the action API, such as collecting page view tracking data.

  ^{Canada Fork Only}

• Backported #8421 for faster metadata updates. Comes with the metadata_modified and metadata_created schemas, allowing for site package migrations with correct metadata for these fields.

  ^Backport

• Faster dataset metadata updates by detecting changes and only updating resource metadata when dataset fields defined by IDatasetForm.resource_validation_dependencies have changed (default: none)

  Now activities are created and metadata_modified updated only if there is a real change.

  metadata_modified may now be set by sysadmins which is useful for harvesting or mirroring.

  The allow_partial_update context parameter has been removed, now normal API users may call package_update without passing resources. In this case the existing resources will remain untouched instead of being deleted.

  package_update and actions that call it now report whether there was a real change by adding the package id to a new changed_entities context value or changed_entities envelope value for API calls.

View it on GitHub [4c887689c...b250af221]

 This repository is only tracked from upstream.

View it on GitHub [fdf805061...96410276f]

  Features

• Added test coverage for core CKAN metadata date fields:

  • metadata_created (Package)
  • metadata_modified (Package)
  • created (Resource)
  • last_modified (Resource)
  • metadata_modified (Resource)

• Added test coverage for core CKAN ckan.site_read_only mode.

  Bugfixes

• Fixed an issue with the extended resource_view_show and resource_view_list actions not being side_effect_free

• Fixed the character encoding in the nap5 schema and filter script to ensure utf-8 strings.

  Changes

• Fixed an issue with the debug toolbar not showing all content.

• Only display the feedback form if there is a value for maintainer_email field. Also, remove the maintainer_email field from Additional Information seaction.

• Briefing Note Titles and Numbers' additional_information_en and additional_information_fr fields use both_languages validation for records with a date_received on or after 2026-02-01

• Adding 2 geospatial resouces formats to the Open Data schema for use by NRCan: COG (Cloud Optimized GeoTIFF) and GeoParquet)

View it on GitHub [94be2a170...5831a15fe]

  Removals

• Removed old Flask login Middleware.

  ^{Canada Fork Only}

  Changes

• Added --list and --yes options to the datastore purge command. The command now handled soft-deleted Resources and Datasets. Fixed an issue with the datastore purge command not querying all datastore tables.

  ^{Canada Fork Only}

View it on GitHub [b64843c51...4c887689c]

  Bugfixes

• Set dependencies greenlet==3.2.4 and gevent==25.5.1 for newer version of Python (3.9.25+) using threading in uWSGI.

• Fixed an issue with the extended datastore_search action function assuming a Resource object exists.

  Changes

• Update link for NAICS identifier field in the description for the Grants & Contributions PD.

View it on GitHub [7b802f676...94be2a170]

  Changes

• Checks if the activity plugin is loaded to render the Activity Stream tab.

View it on GitHub [3c9b2d53d...4dc441548]

  Removals

• Removed the Resource View embed button and modal due to X-Frame-Options: SAMEORIGIN security requirement preventing embeds.

  ^{Canada Fork Only}

View it on GitHub [86783cae1...b64843c51]

  Changes

• Added French translation for Searching... in the Select2 JS autocomplete module.

  ^{Canada Fork Only}

View it on GitHub [a292aad31...86783cae1]

 This repository is only tracked from upstream.

View it on GitHub [bf25d640c...fdf805061]

  Features

• Upgraded DataTables JS contributed library and extensions to latest (as of 2025.03.27) for Recombinant previews. Added various UX improving features:

  • Bootstrap 5 theme for the DataTables;
  • Responsive View;
  • Improved i18n;
  • Fullscreen;
  • Editing in DataTables;
  • General improved functional JS code.

  Must use the option ckanext.canada.enable_pd_datatable_editor

• Added capability to add and override strings in the CKAN i18n API.

• New CLI command export-pd-reporting-info exports data publisher info for Proactive Disclosures into a CSV.

  Changes

• Added --dataset-id (-D) and --ignore-hashes (-i) options to the portal_update command. This is an interim fix to some DataStore tables not syncing to the Portal during the Post to Portal process.

• Update ministers list for December, 2025.

View it on GitHub [779fb61cd...7b802f676]

  Changes

• Further improved error handling and message outputs when processing uploaded Excel files.

View it on GitHub [cb9f93a24...3c9b2d53d]

  Changes

• Unexpected errors during PD Excel doc file uploads now log the exception. Now skips over unexpected "cache" worksheets in the Excel doc when processing uploaded files.

View it on GitHub [9d2e6bc60...cb9f93a24]

 This repository is only tracked from upstream.

View it on GitHub [e27e8c5b5...bf25d640c]

  Removals

• Remove warning alert from the Contracts PD.

  Changes

• Updated the Grants & Contributions schema:

  • recipient_type is required if agreement_start_date is on or after 2025-12-01
  • recipient_business_number must be a 9 digit natural number if agreement_start_date is on or after 2025-12-01
  • prog_name_en is required if agreement_start_date is on or after 2025-12-01
  • prog_name_fr is required if agreement_start_date is on or after 2025-12-01
  • prog_purpose_en is required if agreement_start_date is on or after 2025-12-01
  • prog_purpose_fr is required if agreement_start_date is on or after 2025-12-01
  • agreement_title_en is required if agreement_start_date is on or after 2025-12-01
  • agreement_title_fr is required if agreement_start_date is on or after 2025-12-01
  • agreement_start_date cannot be in the future if agreement_start_date is on or after 2025-12-01
  • agreement_end_date is required if agreement_start_date is on or after 2025-12-01
  • agreement_end_date cannot be before agreement_start_date if agreement_start_date is on or after 2025-12-01
  • agreement_value must be larger than 0 if agreement_start_date is on or after 2025-12-01
  • expected_results_en is required if agreement_start_date is on or after 2025-12-01
  • expected_results_fr is required if agreement_start_date is on or after 2025-12-01
  • recipient_postal_code must be in a valid Canadian postal code format of "A1A 1A1" if agreement_start_date is on or after 2025-12-01
  • federal_riding_number must be a 5 digit natural number if agreement_start_date is on or after 2025-12-01

• Add the following fields to the Edit Member page under download CSV option: - Date created - Last active date

View it on GitHub [581c8812b...779fb61cd]

 This repository is only tracked from upstream.

View it on GitHub [6920fb4c0...c39884278]

 This repository is only tracked from upstream.

View it on GitHub [85eea6733...f2de80a26]

  Changes

• Upgraded the Django framework to version 5. Manual database upgrade for the django_celery_results extenstion required for move to version 2.6.0. Plase note that CDTS must be reamin at version 5.0.1 for now. Note that for Django-celery-results version 2.6.0, a database change is required.

  python .\manage.py migrate django_celery_results --fake zero python .\manage.py migrate django_celery_results 0001

• Switch the SolrClient class to the Pypi library SolrClient2 library from the local project

View it on GitHub [d7a7538a1...522314301]

  Bugfixes

• Upscale to configured URL scheme for relative res_url values from SOLR. This fixes a critical issue to some quirky network middleware behaviours.

  ^{Canada Fork Only}

View it on GitHub [5a8576149...a292aad31]

  Features

• Resource URLs are now only stored as relative paths in SOLR. The request hostname is prepended during package_show

  ^{Canada Fork Only}

  Bugfixes

• Resource Views no longer render fully qualified URIs. They now render relative URIs to allow for safe X-Frame-Options=sameorigin

  ^{Canada Fork Only}

View it on GitHub [c042e2b3d...5a8576149]

  Changes

• Now checks the subdomain for registry to see if the user is in the "Registry" instead of checking if canada_internal plugin is loaded.

• Modified Url to add language in order for the dropdown to be bilingual

• Heavily improved the automated pytests and GitHub workflows.

• Small changes to the AI Strategy yaml (OPEN-4278).

View it on GitHub [90242d5e6...581c8812b]

  Features

• Added a CLI subcommand to help with balancing Excel formulae.

  Bugfixes

• Fixed an issue with the Recombinant combine command assuming extras

  Changes

• Heavily improved the automated pytests and GitHub workflows.

View it on GitHub [39beeb258...9d2e6bc60]

  Features

• Added a new JS module for downloading files via a JS Promise with better UI for large DataStore files.

  ^{Canada Fork Only}

View it on GitHub [51c758461...c042e2b3d]

  Features

• Added support for ckanext-citeproc

• Use the new promise-download CKAN JS module for DataStore Dump links for better UX with larger DataStore tables.

  Changes

• Added SHA384 hash integrities to 3rd party scripts and stylesheets.

• AI Strategy YAML updates: - Increased character limit for description and progress fields from 1000 to 1500 characters. - Improved labels for activity choices based on input from the policy team. - Fixed ordering of primary keys to resolve the delete bug.

• OPEN-4268: Consistently display controlled list Y,N,NA options without labels for Service Inventory Excel template.

View it on GitHub [fca6beb2d...90242d5e6]

  Features

• New command import_code_yaml for updated Code fields from a CKAN recombinant YAML file.

View it on GitHub [79a2a930c...d7a7538a1]

  Changes

• Added autocomplete=off for password fields to secure fields for older browser architecture

  ^{Canada Fork Only}

• Front end resource upload no longer manipulates the upload field's fake path.

  ^{Canada Fork Only}

• The JS i18n API endpoint is no longer cache-able.

  ^{Canada Fork Only}

View it on GitHub [0df71b8eb...51c758461]

  Features

• Obfuscates email addresses rendered in HTML with entity code points. Helps prevent non-advanced Bots from crawling email addresses in HTML content.

• API Token Names have more rigorous validation to help protect the application and database.

  Changes

• Display link for AI Strategy Implementation Tracker on homepage and main menu for users belonging to the TBS organization.

• Update activity codes for AI Strategy yaml to fix the underlying data model.

• Added autocomplete=off for password fields to secure fields for older browser architecture

• If there is no login session, /links will now redirect to the login page.

• Front end guess mimetypes no longer manipulates the upload field's fake path.

• NotAuthorized HTTP responses now have a status code of 404 instead of 403 for logged out users.

• Added alert copy for Organization deleted states.

• Pin python3-cryptography to 45.0.7 in response to RHSA-2025:14553.

View it on GitHub [cc6265096...fca6beb2d]

 This repository is only tracked from upstream.

View it on GitHub [adf1dfa32...5204863bb]

  Changes

• Update author_email from open-ouvert@tbs-sct.gc.ca to opendevelopment-developpementouvert@tbs-sct.gc.ca.

View it on GitHub [60ac362fa...566983d61]

  Features

• Obfuscates email addresses rendered in HTML with entity code points. Helps prevent non-advanced Bots from crawling email addresses in HTML content.

  Changes

• Never browser/client cache the Recombinant templates and Data Dictionary byte streams.

• Replaced hardcoded HelpDesk email address with configurable setting to improve flexibility and maintainability.

• Raise NotFound exceptions for in-active Organizations.

View it on GitHub [95cfdd16c...39beeb258]

  Bugfixes

• Fixed a major issue with Google Analytics not loading and sending tracking data.

View it on GitHub [76b39d63f...cc6265096]

  Changes

• Only output a BOM for CSV and TSV files in Datatables' filter download.

  ^{Canada Fork Only}

View it on GitHub [ff788c4ab...0df71b8eb]

  Bugfixes

• Resource format validator will now fallback to other if the guessed mimetype is not in the list of Scheming choices.

• Fixed an issue with the Admin Publish Workflow page not rendering paging links properly.

  Changes

• service program id list: update from csv

• Service Inventory updates for 2025 FY.

• Service Inventory updates to the data dictionary (2025).

• Ensure the format_type attribute of Recombinant table fields is properly translated and displayed in the following areas for Proactive Disclosures (PD): - Reference tab on individual PD pages - Data dictionary for each PD - Resource page of combined PDs

  This addresses currently missing translations and improves consistency across PD-related interfaces.

• Added mrc file format as a valid Resource format.

View it on GitHub [257395ce1...76b39d63f]

  Features

• Add new template for AI Strategy Tracker proactive publication. Data to be collected only by TBS over a period of 2 fiscal years.

  Bugfixes

• Fixed an issue with the DCAT links not rendering.

View it on GitHub [efb39ae27...257395ce1]

  Bugfixes

• The Search Results export prepends a BOM to the csv files it generates, but the BOM is no longer the first bytes thanks to recent changes to quote column headers names. This is a fix to ensure the BOM comes first.

View it on GitHub [f3193661d...79a2a930c]

  Features

• Now lowercases usernames in the backend of login and password reset.

  ^{Canada Fork Only}

• Added functionality for no-cache, no-store cache control with nocache_store blueprint decorator.

  ^{Canada Fork Only}

View it on GitHub [ea71e2ecd...ff788c4ab]

  Features

• Use the new nocache_store blueprint decorator for login and reset pages.

  Bugfixes

• Extend the Adobe Analytics cookie setting to sanitize javascript:void(0); href attributes.

• Fixed an issue with Adobe analytics scripts not loading with CSP directives.

View it on GitHub [9eb09d118...efb39ae27]

  Features

• Now lowercases usernames in the backend of login.

  ^{Canada Fork Only}

View it on GitHub [b0f087498...a041c0f62]

  Features

• Adds script/style nonce capabilities to Jinja2 webassets.

  ^{Canada Fork Only}

  Changes

• Moved inline styles and JS attributes to classes and event listeners respectfully.

  ^{Canada Fork Only}

• Now sets the Cache-Control header to no-cache, private for logged in users.

  ^{Canada Fork Only}

• Loads image assets instead of data:image URIs for stricter Content-Security-Policy support.

  ^{Canada Fork Only}

View it on GitHub [5eebc542e...ea71e2ecd]

  Features

• Added functionality to define the Content-Security-Policy header in the Flask App instead of NGINX, allowing for script and style dynamic nonce generation. Configurable with ckanext.canada.content_security_policy

  Bugfixes

• filter recovery email sent to logs

  Removals

• Removed old WET Maps files from codebase.

  Changes

• Loads image assets instead of data:image URIs for stricter Content-Security-Policy support. Saved SVG data as images.

• Moved inline styles and JS attributes to classes and event listeners respectfully.

• Customized robots.txt for CKAN instances.

• Modified French translation in the new user form for the password field. It was missing the length limit.

View it on GitHub [c20a7a66f...9eb09d118]

  Changes

• Use the new get_inline_script_nonce helper.

View it on GitHub [c2c45a69c...fc483d993]

  Changes

• Moved inline style attributes into classes and a stylesheet.

• Inline JS HTML callbacks have been moved to event bindings in a javascript file.

• Display format_type for recombinant table fields in the Reference tab and Data Dictionary.

• Use the tags on the Reference tab only for recombinant tables.

View it on GitHub [2933e7491...95cfdd16c]

  Bugfixes

• backport resource view permission check fix from ckan#5910

  ^Backport

  Changes

• Added rel="noopener norefferer" to all _blank target anchors.

  ^{Canada Fork Only}

View it on GitHub [1885cbd87...5eebc542e]

  Changes

• Updated "Examplar" to "Example" for French translation

• Update ministers list after change of role by House of Commons website for Hon. Jill McKnight from Minister of Veterans Affairs to - Minister of Veterans Affairs - Associate Minister of National Defence. Update download_ministers script to ignore invalid positions such as "."

• Fix missing translation updates for support email change.

• Added rel="noopener norefferer" to all _blank target anchors.

View it on GitHub [43415ecac...c20a7a66f]

  Changes

• Added rel="noopener norefferer" to all _blank target anchors.

View it on GitHub [d582eeea6...2933e7491]

 This repository is only tracked from upstream.

View it on GitHub [4a4bf3366...85eea6733]

  Changes

• Add contextual alert for changes to search download results

• Add changes for new search download results functionality

View it on GitHub [8be08fac5...f3193661d]

  Changes

• Add yearly quarters for 2025-2026 to the Departmental Audit Committee proactive publication

• Change the format of "name" field in the Travel and Hospitality Quarterly templates.

• Switch HelpDesk email address from open-ouvert@tbs-sct.gc.ca to PortalSupport-Soutienportail@tbs-sct.gc.ca.

View it on GitHub [665a3af53...43415ecac]

  Changes

• For Search Results exports, use the readable label for the field instead of the database code field name for the exported file header.

View it on GitHub [4c64e76b7...8be08fac5]

  Features

• • Saving a draft dataset is now called "Publish" and an "Unpublish" button is available to move an active dataset back to the draft state.
  • Consistent display of draft state across dataset pages.
  • Error handling is now done on publish, so validators that only apply certain rules to fields for published datasets (e.g. required-only-when-published) will be properly displayed instead of causing a server error.
  • templates/package/new_package_form.html content has been merged into its parent template templates/package/snippets/package_form.html and is now marked as deprecated.
  ^Backport
• • Saving a draft dataset is now called "Publish" and an "Unpublish" button is available to move an active dataset back to the draft state.
  • Consistent display of draft state across dataset pages.
  • Error handling is now done on publish, so validators that only apply certain rules to fields for published datasets (e.g. required-only-when-published) will be properly displayed instead of causing a server error.
  • templates/package/new_package_form.html content has been merged into its parent template templates/package/snippets/package_form.html and is now marked as deprecated.

View it on GitHub [362acb495...1885cbd87]

  Bugfixes

• Now properly checks package permissions for the XLoader and Validation UI pieces, fixes Organization Members not being able to view Datasets and Resources.

  Changes

• Hide the new "Unpublish" button in dataset forms.

View it on GitHub [e02013faa...665a3af53]

 This repository is only tracked from upstream.

View it on GitHub [e617ccc12...6920fb4c0]

  Changes

• Upgrade the following: - drupal/core to 10.3.13 - drupal/google_tag to 2.0.8 - drupal/menu_breadcrumb to 2.0.0 - drupal/bootstrap to 3.35.0

  Add modules for improved security on forms: - drupal/recaptcha_v3 - advanced_email_validation

View it on GitHub [67545d71f...f21e93fd9]

  Releases

• Patched CKAN Core from 2.10.7 to 2.10.8

  ^Backport

View it on GitHub [a877b909e...362acb495]

  Changes

• Increased pytest dependency versions.

• Support email address is now configurable with ckanext.canada.support_email_address. Default maintainer_email is now configurable with ckanext.canada.default_open_email_address

View it on GitHub [db56dbae9...e02013faa]

 This repository is only tracked from upstream.

View it on GitHub [4e9340a93...adf1dfa32]

  Changes

• Increased pytest dependency versions.

• Use the new support_email_address helper from the Canada plugin.

View it on GitHub [44ca5439b...d582eeea6]

  Bugfixes

• Now properly handles string filtering for DataStore text array (_text) fields.

  ^{Canada Fork Only}

View it on GitHub [5765ccf45...a877b909e]

  Changes

• Update ministers list after elections on May 13, 2025.

View it on GitHub [78474345c...db56dbae9]

 This repository is only tracked from upstream.

View it on GitHub [da2daad24...4a4bf3366]

  Features

• Added 2025-2026 fiscal quarters to the valid choices for Proactive Disclosure schemas.

• Improved the display of Resource Validation and XLoader badges to be more clear. Errors/failures will now display in semantic alert areas with a button link to go to the respective report. Successful and Processing badges will display as normal. The Frictionless report items will now be expanded by default, showing the user how to correct the problems in their data.

  Bugfixes

• Fixed an issue with the User Activity template. Sysadmins can now easily navigate to a User's activity page.

  Changes

• Update ministers list for March 14, 2025.

• Moved the validation for TravelQ destination_ and disclosure_group fields to be on or after April 1st 2025.

• Moved the validation for HospitalityQ disclosure_group and _attendee fields to be on or after April 1st 2025.

• The place_of_publication and geographic_region fields now render as Select2 fields.

• Updated the page title, stage/phase labels, and stage/phase buttons on the Dataset form pages.

View it on GitHub [9c59b3715...78474345c]

  Features

• The Search app will no longer accept invalid fields in the URL request. If an invalid field is found, the search app will return a 400 code and display an error message.

  Bugfixes

• The pagination links at the bottom of the Search page can contain the wrong sort order when the application automatically switches the sort type because the user has entered search text for the first time in the session. A different, non-JavaScript approach resolves this issue.

  Changes

• Do a basic reset of the search when the user explicitly starts a new search.

View it on GitHub [c6e5620dc...4c64e76b7]

  Changes

• Specify en and fr language domains in the robots disallow lists.

View it on GitHub [62897d7c5...67545d71f]

  Features

• Render a noindex robots meta tag for search routes.

View it on GitHub [a30084f7b...7cc49a5ea]

  Bugfixes

• Fixed a major issue with using filters in datastore_search with CSV/TSV records format.

  ^{Canada Fork Only}

• backport fix for updating data dictionary with % column names

  ^Backport

View it on GitHub [7a23a0241...5765ccf45]

 This repository is only tracked from upstream.

View it on GitHub [49527ec19...da2daad24]

  Bugfixes

• You can now use non-string values in datastore_search and datastore_delete filters for text datatype fields.

  ^Backport

View it on GitHub [59012805a...7a23a0241]

  Features

• Updated CKAN and Drupal ATI Search Solr configs and schemas to Solr 9 and CKAN 2.10 compatible versions.

  Changes

• Updated the README with up to date information.

View it on GitHub [9623bb30b...9c59b3715]

  Changes

• Updated the README with up to date information.

View it on GitHub [21a7a80c1...44ca5439b]

  Bugfixes

• Fixed text array sorting in datastore_search

  ^Backport

• datastore_search: fix for sort on array column types

View it on GitHub [22e468703...59012805a]

  Bugfixes

• Added missing French translations.

  Changes

• Resource list sidebar now only shows 8 resources with a "Show more" button to display all the resources.

View it on GitHub [6dc353947...9623bb30b]

  Changes

• Updated country names to latest ISO dataset.

View it on GitHub [5fe3a8aa2...6dc353947]

  Features

• Add new command compare_orgs_ckan_json for manaaging the CKAN organization field that is present in most custom searches

  ``` usage: manage.py compare_orgs_ckan_json [-h] --org_file ORG_FILE --field FIELD --search SEARCH [--action {compare,purge_unmatched,add_new}] [--dry_run] [--version] [-v {0,1,2,3}] [--settings SETTINGS] [--pythonpath PYTHONPATH] [--traceback] [--no-color] [--force-color] [--skip-checks]

  Compare existing Organization information from the JSON output of the CKAN organization_list command

  options:

  -h, --help show this help message and exit

  --org_file ORG_FILE Organization List file

  --field FIELD field name

  --search SEARCH search name

  --action {compare,purge_unmatched,add_new} Options are 'compare': show differences between JSON and Codes, 'purge_unmatched': delete codes not found in JSON, 'add_new': create missing codes from JSON

  --dry_run Do a dry run withouth deleting from or adding to the database ```

View it on GitHub [e2ecc471c...c6e5620dc]

  Changes

• TravelQ schema has additional destination fields added, along with validation for expected format.

• HospitalityQ schema has additional vendor fields added, along with validation for expected format.

• Remove the unused --quiet option for Search csv import from the PD Makefile

View it on GitHub [4e42125d9...5fe3a8aa2]

  Features

• The plugin now supports public Power BI embeds.

View it on GitHub [1eb77c596...2ef2f7b27]

  Changes

• datastore_create will no longer attempt to create the Full Text Index if the record count is above ckanext.canada.max_ds_fts_rows (default: 100,000). This allows for proper editing of the Data Dicitonary for larger DataStore Resources.

  <sup>Canada Fork Only</sup>

View it on GitHub [bdf5d4f63...22e468703]

  Features

• Adds another Recombinant alert area, use template_warning in the Schema.

  Removals

• Move PCO sub-org migration scripts to https://github.com/open-data/data-ops/tree/main/pco/migrate

  Changes

• Set the correct template_updated for all PD types.

• Set configuration for public_activity_stream_detail to False.

View it on GitHub [23dcfe836...4e42125d9]

  Features

• Added the Bookmark field to specify a default bookmark value for a Power BI report.

  Changes

• Added mapping for supported language locales for Power BI.

View it on GitHub [bfe23b4ac...1eb77c596]

  Bugfixes

• Translated the semicolon in Last Updated display.

View it on GitHub [a660293b9...21a7a80c1]

  Changes

• Move GCNotify callback processing to cron task to improve response time for callbacks.

View it on GitHub [a2e8dc441...9c54523b6]

  Releases

• Updated CKAN 2.10 from 2.10.4 to 2.10.7

  <sup>Backport</sup>

  Features

• Update release process docs

  Bugfixes

• Invalidate cached pages and load fresh ones if cookies change

• Fix check_access order for resource create view

• Fix auth check for datastore data dictionary view

View it on GitHub [c946fb840...bdf5d4f63]

  Features

• Foreign keys will now display HTML links to the referential data in PD DataTables.

View it on GitHub [24972adb2...23dcfe836]

  Bugfixes

• Fixed an issue where the radio buttons in the form would not appear with some version of Bootstrap.

  Changes

• The view no longer renders inside of an iFrame.

View it on GitHub [27ff71c84...bfe23b4ac]

  Features

• Now handles nested resource validation errors. Creating, updating, and deleting a resource can catch and handle validation errors from other resources in the dataset.

  <sup>Canada Fork Only</sup>

• Added a filename option to the DataStore Dump endpoint.

  <sup>Canada Fork Only</sup>

  Changes

• Foreign constraint pSQL errors are now fully parsed with improved error messages, along with extra constraint info passed in constraint_info

  <sup>Canada Fork Only</sup>

View it on GitHub [c7e89f588...c946fb840]

  Features

• Added a select all checkbox to the PD DataTables.

• Added the capability to set a search query to the PD DataTables with the URI parameter dt_query

  Bugfixes

• Fixed the logic for target_met calculated field for Service Standard.

  Changes

• Merge PD records of the following sub-organizations under PCO:

  • Deputy Prime Minister & Minister of Finance (dpm-vpm)
  • Intergovernmental Affairs (iga-aig)
  • Minister of Intergovernmental Affairs, Infrastructure & Communities (miga-maig)
  • Office of the Leader of the Government in the House of Commons (ghl-lgc)
  • Office of the Minister of Democratic Institutions (mdi-mid)
  • Quebec Lieutenant (ql-lq)
  • Special Representative for the Prairies (srp-rsp)

• Aligned the Delete and Create PD view functions with new Recombinant code for improved constraint error messages.

• Display errors on the Confirm Resource Delete page. Added new translations for nested resource validation errors. Adds a ckanext-scheming template for the nested resource validation errors to display field labels from the Schema.

• Added test coverage for the filter_service_std.py script.

• Display resource format labels in the Additional Information section on Resource pages.

View it on GitHub [4c60b9b35...24972adb2]

  Bugfixes

• Changed the PowerBI wrapping aspect ratio container to a fixed position.

View it on GitHub [67871cb5c...27ff71c84]

  Features

• When exporting/editing records in Excel, any referencing/referenced records will be included in the respective Excel sheets, barring that the referential table belongs to the same dataset.

• Improved the constraint error messages by including the referenced/referencing key values and resource. Add {refKeys}, {refValues}, and/or {refTable} in a defined constraint error message for dynamic string replacements.

• Now handles specific KeyError exceptions and fields errors as RecombinantFieldError exception when downloading and uploading Excel records, showing the user a new error message. Sysadmins will be prompted to refresh the resource.

• Added the DataStore Dump button for sysadmins to the Recombinant edit template.

  Bugfixes

• Fixed an issue with the Delete records view function not redirecting to the Preview page.

  Changes

• Now gracefully handles browser page refreshes on POST views.

• recombinant_update with force and delete_fields will now DROP old columns from the DataStore for fields that do not exist in the Schema.

View it on GitHub [b00bcfed0...a660293b9]

  Bugfixes

• Update script that loadsthe search query logs. It was failing when attempting to load invalid queries

View it on GitHub [a8a9845aa...b19cc4970]

  Features

• Added more resource formats:

  • BUFR
  • CAP
  • WATERML1
  • WATERML2

  Changes

• The Portal Update command will send correct exit codes when the worker pool fails.

View it on GitHub [19ab9b00c...4c60b9b35]

  Bugfixes

• Fixed an issue with the load_csv command in which it would raise exceptions when passing non-existing fields to the DataStore.

View it on GitHub [5c30d7a50...b00bcfed0]

  Changes

• Add a 200 response when GCNotify sends a health check request to callback endpoint.

View it on GitHub [e8ffb4607...fa989c99b]

  Bugfixes

• Fixed a bug with organization_packages_background_reindex raising an exception during _group_or_org_update

  <sup>Canada Fork Only</sup>

View it on GitHub [2888dce06...c7e89f588]

  Bugfixes

• Fixed an issue with the app global is_registry for new Jinja versions.

  Removals

• Removed old, unused scripts from bin and migration

  Changes

• Refactor code to meet CKAN and Python coding standards.

• Use ckan.plugins.toolkit instead of ckantoolkit

View it on GitHub [b40473c7f...19ab9b00c]

  Changes

• Use ckan.plugins.toolkit instead of ckantoolkit

  <sup>Canada Fork Only</sup>

View it on GitHub [65be4ae51...e91851c80]

 This repository is only tracked from upstream.

View it on GitHub [1c29c017b...4e9340a93]

  Changes

• Refactor code to meet CKAN and Python coding standards.

View it on GitHub [1d4ea1ff5...5c30d7a50]

 This repository is only tracked from upstream.

View it on GitHub [5ce30cf28...49527ec19]

  Changes

• Use ckan.plugins.toolkit instead of ckantoolkit

  <sup>Canada Fork Only</sup>

View it on GitHub [61cc99a59...bccc5d6b1]

  Changes

• Use ckan.plugins.toolkit instead of ckantoolkit

  <sup>Canada Fork Only</sup>

View it on GitHub [e30258719...01db87288]

  Removals

• Remove configuration files for deprecated 'Suggest a dataset' feature.

View it on GitHub [9e44e51b6...62897d7c5]

  Removals

• Remove deprecated code for the 'Suggested Datasets' feature.

View it on GitHub [2fe0995e9...e8ffb4607]

  Removals

• Remove deprecated code for the 'Suggested Datasets' feature.

View it on GitHub [0f376ace8...595c588c6]

  Bugfixes

• Fixed an issue with the User Update schema not requiring name but we always need name for the password validator. User name cannot be modified still.

  <sup>Canada Fork Only</sup>

View it on GitHub [406d2c0d7...b0f087498]

  Bugfixes

• Allow searching with special characters in DataTables views.

  <sup>Canada Fork Only</sup>

• Do not allow password reset for Deleted users.

  <sup>Canada Fork Only</sup>

  Changes

• Disable the DataTables view FTS search if the record count is above ckanext.canada.max_ds_fts_rows (default: 100,000 rows)

  <sup>Canada Fork Only</sup>

View it on GitHub [1055e3c70...2888dce06]

  Removals

• Removed the old API Key modal from the user profile template.

  Changes

• Aligned test cases with new Recombinant code.

• Limit datastore_search with FTS searching with ckanext.canada.max_ds_fts_rows (default: 100,000 rows)

View it on GitHub [76045e5bf...b40473c7f]

  Changes

• Refactor code to meet CKAN and Python coding standards.

View it on GitHub [15ebfcc01...60ac362fa]

  Changes

• Refactor code to meet CKAN and Python coding standards.

View it on GitHub [9131c3f6f...5e527915c]

  Changes

• Refactor code to meet CKAN and Python coding standards.

View it on GitHub [1154558cd...67871cb5c]

  Changes

• Allow for DS Type Overrides in the published resource Data Dictionaries. The UI will still display the type from the Recombinant Schema.

• format_trigger_error is now done at a logic level instead of view level.

View it on GitHub [947384a14...1d4ea1ff5]

  Bugfixes

• Fixed the username validator.

  <sup>Canada Fork Only</sup>

  Changes

• Changed failed login attempts to log level INFO for our production environment logging configurations.

  <sup>Canada Fork Only</sup>

View it on GitHub [3357c7764...406d2c0d7]

  Bugfixes

• Handled database timeout exceptions to close temporary files.

  <sup>Canada Fork Only</sup>

  Changes

• Limit the FTS index to ckanext.canada.max_ds_fts_rows (default: 100,000 rows)

  <sup>Canada Fork Only</sup>

View it on GitHub [e2fbdf99d...e30258719]

  Features

• Adding some additional code for measuring the use of facets. Requires a model change.

View it on GitHub [e34a89ef1...bca348a81]

  Changes

• • Maintain only one ministers list for both Question Period Notes and Use of Administrative Aircraft.
  • Update ministers list to include Governor General choice
  • Remove aircraft ministers list
  • Update Aircraft PD template to use ministers list and add last updated date
  • Update QPNotes PD template to filter GG from the choices list and add last updated date

View it on GitHub [1599b7a59...76045e5bf]

 This repository is only tracked from upstream.

View it on GitHub [296785eab...42aef2e76]

  Features

• Filter any options from the recombinant choice field by using choices_filter in the yaml.

View it on GitHub [dc3dc2c63...947384a14]

  Removals

• Remove deprecated PD searches. The only active search is Access to Information summaries.

View it on GitHub [5d6651dac...2fe0995e9]

  Changes

• Update ministers list for December, 2024.

• Update ministers list for January, 2025.

• Remove rebuilding wrongdoing for the Drupal search.

View it on GitHub [6a7e43fe3...1599b7a59]

  Bugfixes

• Fixed an issue with the i18n directory not being found.

  <sup>Canada Fork Only</sup>

View it on GitHub [ffdf2e33a...3357c7764]

  Features

• Modified the custom Search export to use standard formating for the JSON output. This makes it much easier for developers to compare changes between releases of new versions of a custom search.

  Also added the standard Open Government GitHub PR workflow to the project.

• Removing the javascript polyfill.min.js from the RAMP viewer due to integrity concerns

View it on GitHub [579d7549c...e34a89ef1]

  Features

• Display clickable links in the comment field on the ATI Details view.

View it on GitHub [c6e6f8c3e...5d6651dac]

  Features

• Added Dataset & Resource repeating Relationship field groups.

• Allow remote DataStore sources. Allow domains with ckanext.canada.datastore_source_domain_allow_list

View it on GitHub [b672b3a74...6a7e43fe3]

  Removals

• Removed Excel Template version 2 capabilities. Use version 3.

View it on GitHub [7074987aa...dc3dc2c63]

  Features

• Allow remote DataStore sources. Allow domains with ckanext.canada.datastore_source_domain_allow_list

  <sup>Canada Fork Only</sup>

View it on GitHub [852f9bdb0...61cc99a59]

  Features

• Allow remote DataStore sources. Allow domains with ckanext.canada.datastore_source_domain_allow_list

  <sup>Canada Fork Only</sup>

View it on GitHub [26e9bdbb1...e2fbdf99d]

  Features

• Added a new global template snippet to allow custom 'teasers' above the search bar.

  Please note, it is necessary to to perform a Django DB migration for this feature

  Also adding JSON formatting to the Search Import/Export files to make it easier to track changes

View it on GitHub [728d18447...579d7549c]

  Bugfixes

• Fixed a typo in the originating_sector_fr field example for Briefing Note Titles and Numbers.

• Fixed Excel formulae for Grants & Contributions.

  Changes

• Updated various field descriptions and obligations for Grants & Contributions.

• Wrongdoing Search has been implemented on OC Search. For now, the Proactive Disclosure Makefile is being modified to rebuild both the Drupal and Django searches during the nightly rebuild.

View it on GitHub [aa54fe2e3...b672b3a74]

  Features

• Enable the Search Help page for ALL searches, not just Open Data.

View it on GitHub [f8073edf0...728d18447]

  Releases

• Released CKAN 2.10 compatible code.

  <sup>Canada Fork Only</sup>

  Features

• Added UI for search index rebuilding. Added background jobs for search index rebuilding.

  <sup>Canada Fork Only</sup>

• Enabled saving of activities on private datasets.

  Added permission_labels column to Activity table.

  Added filtering of dataset activities based on user permission labels.

• Added pages to confirm User delete and Dataset Collaborator delete. Fixed cancellation of Group Member delete.

• datastore_create: Add a delete_fields flag that must be set to True to delete any existing fields not passed in the fields list

• Activity plugin now tracks new, changed, and deleted resource views.

• datastore_records_delete action now calls the datastore_delete action via the toolkit for better frameworking.

• Resource view list items now have an additional view-item class.

• Add --max-idle-time to the ckan jobs worker command.

  Bugfixes

• Fix 500 error caused from passing null to a field using the ckanext.datastore.logic.schema.json_validator in its schema

• Fixed context in set_datastore_active_flag to solve possible solr errors during index_package

• Aligned member_create with group_member_save to prevent possible member duplication.

• Fixed issues with the ckan views create CLI sub-command.

  Changes

• Change the log level in default_authenticate from debug to info for the canada fork only. Related to https://github.com/open-data/ckanext-security/pull/8

  <sup>Canada Fork Only</sup>

View it on GitHub [d8d0e9647...1055e3c70]

  Releases

• Released CKAN 2.10 compatible code.

  <sup>Canada Fork Only</sup>

View it on GitHub [3799984c7...f525f0286]

  Releases

• Released CKAN 2.10 compatible code.

  <sup>Canada Fork Only</sup>

View it on GitHub [c71562611...65be4ae51]

  Bugfixes

• Catch request errors when retrieving an embed token.

View it on GitHub [4b6b81f52...1154558cd]

  Releases

• Released CKAN 2.10 compatible code.

View it on GitHub [37bcb33dd...7074987aa]

  Releases

• Released CKAN 2.10 compatible code.

  <sup>Canada Fork Only</sup>

  Features

• Added the capability to enforce strong passwords at login.

  <sup>Canada Fork Only</sup>

• Log failed and successful login authentications

  <sup>Canada Fork Only</sup>

View it on GitHub [2acf49226...ffdf2e33a]

  Releases

• Released CKAN 2.10 compatible code.

  <sup>Canada Fork Only</sup>

View it on GitHub [c944c9b9b...852f9bdb0]

  Releases

• Released CKAN 2.10 compatible code.

  <sup>Canada Fork Only</sup>

View it on GitHub [a3ea5b266...26e9bdbb1]

  Releases

• Released CKAN 2.10 compatible code.

  <sup>Canada Fork Only</sup>

View it on GitHub [HEAD...81be82a29]

  Changes

• Updated Service Inventory fields volume_meeting_target and total_volume from int to bigint

View it on GitHub [f71b5d79d...f5e312fc3]

  Bugfixes

• Fixed Service Inventory service_name fields character limit increase to 350 at the DB level.

View it on GitHub [19f053cc7...f71b5d79d]

  Changes

• You can now specify a REDIS queue with ckanext.validation.queue_name config option.

  <sup>Canada Fork Only</sup>

View it on GitHub [e94671fdd...c944c9b9b]

  Changes

• You can now specify a REDIS queue with ckanext.xloader.queue_name config option.

  <sup>Canada Fork Only</sup>

View it on GitHub [b78d01f19...a3ea5b266]

  Changes

• Resource file size now displays in a human-readable format.

• Updated description copy for Service Inventory Fiscal Year fields. Updated maximum characters for Service Name fields from 250 to 350.

View it on GitHub [2ca47a608...19f053cc7]

  Changes

• max_chars schema field argument now displays in Data Dictionaries as Character Limit

View it on GitHub [2b5ae29e8...37bcb33dd]

  Changes

• • Remove the social media pillars from template
  • Remove the citation feature

View it on GitHub [0e4d58d69...afa537aa7]

  Bugfixes

• Add validation fields to info schema. Add missing translations for validation: - Validation timestamp - Validation status

• Fixed a reference assignment error in the deleting views code block of PortalUpdater. PortalUpdater will now give a system exit code 1 if there are any errors in the process.

• Add translations for the resource field validation_status

View it on GitHub [f3167636c...2ca47a608]

  Bugfixes

• Service Inventory primary key fields no longer allow commas.

View it on GitHub [1fdbfac47...f3167636c]

  Bugfixes

• Fixed syntax issue with the new calculate-filesizes CLI command.

  <sup>Canada Fork Only</sup>

View it on GitHub [1cf3674a6...3799984c7]

  Features

• Add new Indigenous language "Innu-Aimun" to presets.yaml.

View it on GitHub [6e940c9c3...1fdbfac47]

  Features

• Added PackageSync model for the package_sync table which tracks the PortalUpdater process and saves the states for the packages.

• The number of resources per dataset can now be limited with the ckanext.canada.max_resources_per_dataset config option.

  Changes

• Display resource metadata such as Language, Format etc. on the resource page under 'Additional Information'.

• The old GCPedia links now link to the Operations Guide. Text GCPEDIA changed to Operations Guide.

• Adding the Django Search to the PD Makefile for the Hospitalityq type.

• Remove rebuilding the following searches from the Makefike: - reclassification - hospitalityq The above searches are now rebuilt using the Django search.

• Added --include-types and --exclude-types options to the delete-activities command.

View it on GitHub [7986755ea...6e940c9c3]

  Bugfixes

• Set the filesize attribute in the uploader class so CKAN can set the Resource file size metadata field in package_update.

  <sup>Canada Fork Only</sup>

View it on GitHub [a264d6b75...1cf3674a6]

 This repository is only tracked from upstream.

View it on GitHub [27035f4d5...5ce30cf28]

  Features

• Add custom code and fields to the Open Data search to allow searching by Department name or acronym. For example, "Treasury Board Secretariat" or "TBS". Quotes are not required.

• Added a new Django template filter "intformat" that allows developer to apply custom python integer formatting.

  Bugfixes

• Improved error handling of the data_import_ckan_json command to avoid throwing a second exception when try to log very large error messages.

View it on GitHub [0cb1b6178...525370deb]

  Features

• Apply security update for: - SA-CORE-2024-002 - SA-CONTRIB-2024-047

View it on GitHub [96456839d...9e44e51b6]

  Features

• Update Drupal core to version 10.2.10 to apply security updates for SA-CORE-2024-002. Update Drupal Facet contributed module to apply security updates for SA-CONTRIB-2024-047.

  Bugfixes

• Pass empty string for referer_url to avoid exception in the PHP explode function. This behaviour is new in PHP8.

View it on GitHub [799cfb02b...c6e6f8c3e]

  Bugfixes

• Fix version numbers in composer.json for wet to v4.0.79 and gcweb to v15.0.0

View it on GitHub [534a9cbab...0e4d58d69]

  Changes

• Added ckan_phase block to the package_form template to allow for no-phased dataset forms.

  <sup>Canada Fork Only</sup>

• Markdown help popup content has been updated.

  <sup>Canada Fork Only</sup>

View it on GitHub [c2b1c0888...d8d0e9647]

  Features

• Added additional Resource formats sprite sheet and added supported Resource formats:

  • FLV
  • MKV
  • MP4

  Bugfixes

• Fixed an issue with the Standard Service filter script not handling null performance fields.

  Changes

• Reclassification Search has been implemented on OC Search. For now, the Proactive Disclosure Makefile is being modified to rebuild both the Drupal and Django searches during the nightly rebuild.

• Markdown help popup has been translated.

View it on GitHub [9a60d2fb4...7986755ea]

 This repository is only tracked from upstream.

View it on GitHub [e8d7e3fe9...296785eab]

  Bugfixes

• Fixed an issue with Activity Streams and purged packages.

  Changes

• Excel _text field error formulae are now case sensitive.

View it on GitHub [f5226596a...2b5ae29e8]

  Changes

• Add a link to "Proactive disclosure" to the existing breadcrumb trail for searches. The Open Data search is excluded and will continue to have a custom breadcrumb trail.

View it on GitHub [d38300eca...0cb1b6178]

  Bugfixes

• fix: datatables column headings missing spaces remove broken nbsp-replacement code instead of fixing (doesn't handle other whitespace characters)

  Changes

• Update ministers list after changes on Sept 19, 2024.

View it on GitHub [918f970d3...9a60d2fb4]

  Bugfixes

• Fixed language switching in Flask requests that was affecting the XLSX DataDictionary and JSON Schema downloads.

View it on GitHub [87f8683eb...f5226596a]

  Changes

• Some minor modifications to the database, data handling code, and search templates for the Data Strategy Trackers. These modifications support changes to the data in order to incorporate multi-year updates, as this is the second year for the tracker.

View it on GitHub [0f711b271...d38300eca]

  Features

• DataStore now supports foreign key constraints. Supply foreign_keys dictionary to the datastore_create action method.

  <sup>Canada Fork Only</sup>

  Bugfixes

• Fixed an issue with the binding of the table-toggle-more JS CKAN module.

  <sup>Canada Fork Only</sup>

  Changes

• Markdown no longer renders heading and image tags for accessibility reasons.

  <sup>Canada Fork Only</sup>

View it on GitHub [939d61e65...c2b1c0888]

  Features

• Released new Service Inventory schema.

• Re-enable service inventory in the Makefile. Search will continue to stay disabled at this time. Add filters for service inventory tables for populating the following fields:

  • num_applications_total

  • program_name_en and program_name_fr

  • performance

  • target_met

  Changes

• Create and Update PD Record views will now log the fatal warnings with their tracebacks instead of eating errors.

• DataDictionary description fields now renders the markdown contents.

View it on GitHub [0c40c2b69...918f970d3]

  Features

• Added new published DataDictionary XLSX and Schema JSON routes to include published fields.

• Recombinant field schemas now support max_chars, limitting the field value to a character count with an excel formula. Use the max_char_error Database trigger/function from the Canada extension.

• The datastore_info action method now shows the field schema in the field info for Recombinant resources and Published resources.

• Recombinant chromos now support DataStore foreign key constraints. The Recombinant plugin limits all foreign key usages to Recombinant resources.

  Bugfixes

• Excel reference sheets now display the correct field number for the resource fields. Excel DataDictionary reference sheets now display the correct resource titles.

• Fixed an issue with full text choices not spanning 2 columns in the Excel reference sheet.

  Changes

• Added format_trigger_error method to format Database errors in a pythonian way to support language translations in the CKAN framework.

• The DataDictionary form will now show the Recombinant resource's schema as readonly fields. The DataDictionary front-end will now show non-schema fields such as any additional fields added by filter scripts, allowing normal usage of DataDictionary for these fields.

• The Occurence from field schemas will now display in the Excel reference sheet and in the DataDictionary front-end.

• Uploading an Excel file now requires all worksheets to pass validation for the records to be committed to the database.

View it on GitHub [eb030994b...87f8683eb]

  Bugfixes

• Display accented characters properly in Excel for filtered results downloaded using datatablesview.

  <sup>Canada Fork Only</sup>

View it on GitHub [0018caa88...939d61e65]

  Bugfixes

• Bugfix for character encoding on title_en and title_fr columns on the Open Government Portal Department List dataset

View it on GitHub [1023f8322...0c40c2b69]

  Bugfixes

• nap5: enforce validation on status, progress fields

  Changes

• • show title with truncated link text
  • show title in breadcrumbs
  • increase breadcrumb length to 80 for package and resource
  • increase title length from ckan's default 80 to 150 before truncating
  • use the breadcrumb trail guidance to not display the current page at the end of the breadcrumb trail (linked or unlinked) for the Portal only https://design.canada.ca/common-design-patterns/breadcrumb-trail.html

• Add an alert on login page for users to change password in order to comply with the new password requirements.

View it on GitHub [b5840e5e7...1023f8322]

  Changes

• Removed 100,000 row limit from search result downloads

View it on GitHub [1ff0732ba...f5b2cf8fc]

  Bugfixes

• The URL on resource pages shows English URL from cloudstorage for resources uploaded to the datastore. The immediate fix is to remove the URL since it is repetitive. This would not have any impact on UX because users can use the blue button to download resources.

• add published_resource_id for the QPNOTES-nil.csv resource file. Needed for PR 1507

  Changes

• Enabling upload of the QPNOTES-nil.csv file now that there is nothing-to-report data for QPNOTES PDs.

View it on GitHub [0b399f270...b5840e5e7]

  Bugfixes

• Check for None type in update_pd_record for the money field

View it on GitHub [44b433d16...0b399f270]

  Features

• Have added a new custom Solr field type that is very similar to the existing string type but allows for case-insensitive matching. Intended for key fields like Reference Numbers or other identifiers.

  The following Custom Search Fields were updated:

  • QP Notes: reference_number
  • Briefing Titles: tracking_number
  • Travel: ref_number
  • Grants: recipient_legal_name, recipient_country, ref_number, recipient_postal_code, recipient_city_en, recipient_city_fr, naics_identifier

View it on GitHub [797471e83...1ff0732ba]

  Changes

• Update the ministers json file

View it on GitHub [0317430b5...44b433d16]

  Features

• Add feature to delete selected rows from pd preview table.

  Bugfixes

• • Fix translation for content type
  • Add space with colon (:) on forms

View it on GitHub [71f707fe0...0317430b5]

  Changes

• Improvements made to the Contracts search to better handle minor data variations. Result is fewer indexing errors reported during loading of contracts data.

View it on GitHub [8b206626a...797471e83]

  Features

• Display invitation-manager survey pop-up on select pages and views

View it on GitHub [8d53248ab...799cfb02b]

  Bugfixes

• Contextual temporary database table datastore_user now only gets created if it does not already exist.

• Added casting to NUMERIC for the DAC triggers to support old money column types.

  Changes

• Proactive Disclosure money field values now always display as a money format in DataTables and Update Single Record form.

View it on GitHub [63f6de711...71f707fe0]

  Bugfixes

• Added parsing for money strings when writing to Excel sheets to support old money column types.

• Fixed the remove-broken command by also deleting the Resources.

  Changes

• The run-triggers command now catches Validation errors and continues.

View it on GitHub [d7d97a729...eb030994b]

  Features

• Added UI for sysadmins to unlock user accounts.

• Integrate survey pop-up using GC invitation-manager on dataset pages.

• Add validation for no commas allowed to proactive publication reference number fields. The change applies to:

  • adminaircraft.yaml

  • ati.yaml

  • briefingt.yaml

  • consultations.yaml

  • contracts.yaml

  • grants.yaml

  • hospitalityq.yaml

  • qpnotes.yaml

  • reclassification.yaml

  • travelq.yaml

  • wrongdoing.yaml

• Show password requirements for "Password" and "Confirm Password" fields on new user registration page.

  Bugfixes

• Fixed the Openness Report script. Moved the code inside of the CKAN app context. Use the ckan canada openness-report command now.

  Removals

• Remove alert about contracts proactive publication from the Registry login and home pages.

  Changes

• Translated more colons for French.

• Money fields for PD types now get rounded to 2 decimals when inserting into the database.

• The Makefile no longer falls back to /tmp for the temporary directory. It will always use the PD_TMP_DIRECTORY or TMPDIR environment variables. You can now supply tmpdir=/path/to/tmp/directory. The Makefile will fail if no temporary directory is found.

View it on GitHub [fe1a5719b...63f6de711]

  Features

• Adds notify_lockout to support the mailer from ckanext-security for Account Lockout.

View it on GitHub [40df11d62...15ebfcc01]

  Changes

• Increased the verbosity of the combine command.

View it on GitHub [629402f07...d7d97a729]

  Features

• Added support for the GC Notify mailer overrides.

  <sup>Canada Fork Only</sup>

View it on GitHub [0c826045e...2acf49226]

  Bugfixes

• Always close temporary files during exception handling. Added exception handling for REDIS Job Queue timeouts.

  <sup>Canada Fork Only</sup>

View it on GitHub [c880ec38c...b78d01f19]

  Features

• Added English and French versions of a new Search Tips page to the Search app.

  • https://search.open.canada.ca/page/help/?opendata

  • https://rechercher.ouvert.canada.ca/page/aide/

  At the moments, the search tips only appear on the Open Data Search page. Other PD types will be added at a later date.

  Bugfixes

• Minor field name and code changes to the NAP 5 Tracker to sync it with the latest data from the portal

View it on GitHub [9c1965094...8b206626a]

  Changes

• Updated datastore_field_name validator error message to align with the backend error message.

  <sup>Canada Fork Only</sup>

• Added Show All and Hide All to Datatables view form for column visibility.

  <sup>Canada Fork Only</sup>

• Datastore dump XML format now conforms to the standards for XML element names.

  <sup>Canada Fork Only</sup>

View it on GitHub [ccf27b753...0018caa88]

  Features

• Load the GCWeb and WET assets and scripts from the CDTS CDN.

• Use the WET JS Builder to comply with the CDTS templates. Updated the error template. The Registry now uses the WET Application templates.

• Add translations for feature to validate password. The user password cannot be the same as username.

  Bugfixes

• Fixed inline colons for French in various templates. E.g. Date Published: -> Date de publication :

• Bugfix for the validation report not rendering because it does not recognize this.ckan

  Changes

• New canada_theme plugin contains merged Internal and Public templates, assets, and new is_registry global.

• Added new CSS layout for Datatables' column visibility modal.

View it on GitHub [b69902046...fe1a5719b]

  Features

• Add validation for user password which cannot be the same as username.

  <sup>Canada Fork Only</sup>

View it on GitHub [6652d05f4...0c826045e]

  Changes

• Bugfix for the validation report not rendering because it does not recognize this.ckan

  <sup>Canada Fork Only</sup>

View it on GitHub [bc5c2f7a7...e94671fdd]

  Changes

• Updated fields error output messages to align with the new DataStore fields sub-schema.

  <sup>Canada Fork Only</sup>

View it on GitHub [177d93aea...c880ec38c]

  Features

• Added validation for Datastore field names. They can no longer contain Control characters.

  <sup>Canada Fork Only</sup>

View it on GitHub [44417ec1c...ccf27b753]

 This repository is only tracked from upstream.

View it on GitHub [80fd93132...e27e8c5b5]

  Features

• add 3 open maps file formats: COG, APRX, PBF

View it on GitHub [c32951dee...b69902046]

  Features

• Added support for Service Canada's Survey Invitation Manager (https://github.com/ServiceCanada/invitation-manager).

  By default this feature is disabled. In order to enable it:

  1. Add "IM_ENABLED = True" to the Django project's settings.py file
  2. Extract the contents of the Invitation-manager release to the "search/templates/snippets/im" directory in the project
  3. Configure IM appropriately using the "im.json" and "config.JSON" files.

View it on GitHub [eabdd87b1...9c1965094]

  Bugfixes

• Trim Proactive Disclosure text fields to 28kB for Solr record indexing. This affects PD types that do not use the Advanced Search (Django) app.

  Changes

• Update 'Get started' sentence on the FAQ page for the Registry users.

View it on GitHub [24ef4387d...c32951dee]

 This repository is only tracked from upstream.

View it on GitHub [c4e6dd884...1c29c017b]

  Bugfixes

• format money(float) type to 2 decimal places to improve precision

View it on GitHub [f0904c953...629402f07]

 This repository is only tracked from upstream.

View it on GitHub [83a66ca19...27035f4d5]

  Bugfixes

• Added a schema for performing password resets, allowing for better frameworking for password requirements and error messages.

  <sup>Canada Fork Only</sup>

View it on GitHub [95d119bca...44417ec1c]

  Changes

• Updated the CanadaSecurityPlugin class for the improved frameworking from ckanext-security.

• Minor changes to the FAQ page for the Registry users.

View it on GitHub [1b9297f30...24ef4387d]

  Features

• Adds ckanext.security.min_password_length config option to set minimum password length requirement.

  <sup>Canada Fork Only</sup>

• Adds ckanext.security.nzism_compliant_passwords config option to set password complexity requirements.

  <sup>Canada Fork Only</sup>

  Changes

• Improved the frameworking of the Security plugin to allow for better password requirements and error messages.

  <sup>Canada Fork Only</sup>

View it on GitHub [14a9635d8...6652d05f4]

  Features

• Added --max-idle-time option to the ckan jobs worker command.

  <sup>Canada Fork Only</sup>

View it on GitHub [2f535dd1c...95d119bca]

  Changes

• Create and Update PD Record forms now have better error messaging.

View it on GitHub [e077094b7...1b9297f30]

  Features

• Prevent duplicate dataset_type, resource_name, published_resource_id, and triggers dict keys across table definitions.

• Added test coverage for Recombinant table definitions.

  Changes

• Uploading an XLS file will now redirect the user to the correct Recombinant Resource.

View it on GitHub [37337fa1c...f0904c953]

 This repository is only tracked from upstream.

View it on GitHub [9a33dcd33...83a66ca19]

  Features

• Added capability for designated job worker queues per resource.

  <sup>Canada Fork Only</sup>

View it on GitHub [b9e853203...bc5c2f7a7]

  Features

• Added capability for designated job worker queues per resource.

  <sup>Canada Fork Only</sup>

View it on GitHub [e714cc0f2...177d93aea]

  Features

• Added very basic automated tests for the Grants and Contributions PD Search

View it on GitHub [bf802cc4f...eabdd87b1]

  Bugfixes

• Fixed an issue with the Registry Organizations to CSV script.

• Ignore the metadata_modified Resource field in the "Post to Portal" code. Fixing a major issue where a Dataset's metadata_modified field would be updated, and a lot of activities would be created on the Portal.

  Changes

• Moved FAQ page content from Markdown files into a Jinja template. Moved the French translated strings into the PO file.

View it on GitHub [b6c97720d...e077094b7]

  Features

• Add support for French Boolean search keywords and add a note to the technical documentation explaining how to use Boolean search terms including:

  • AND / ET

  • OR / OU

  • MOT / PAS

  • Quotation marks ""

  • Parenthesis ()

  • Asterisks *

  Bugfixes

• Fixed issue with the "Show similar records" links in the Travel PD search

  Changes

• Updated Search to use the latest version of WET/CDTS, 5.0.1

View it on GitHub [99f94d036...bf802cc4f]

  Features

• upgrade libraries wet to v4.0.79 and gcweb to v15.0.0

View it on GitHub [71c02225e...96456839d]

  Features

• upgrade libraries wet to v4.0.79 and gcweb to v15.0.0

View it on GitHub [937d69d51...8d53248ab]

  Features

• upgrade cdts to v5.0.1, wet to v4.0.79 and gcweb to v15.0.0

  Bugfixes

• open-3420: resolve issues with analytics page by removing obsolute ie8 libraries

View it on GitHub [9af9b868b...534a9cbab]

  Changes

• Released Python 3 compatible code.

  <sup>Canada Fork Only</sup>

View it on GitHub [acc1a2986...2f535dd1c]

  Changes

• Released Python 3 compatible code.

View it on GitHub [6d9e428b6...b6c97720d]

  Changes

• Released Python 3 compatible code.

  <sup>Canada Fork Only</sup>

View it on GitHub [c9f2f5fca...c71562611]

  Changes

• Released Python 3 compatible code.

View it on GitHub [272082601...37337fa1c]

  Changes

• Released Python 3 compatible code.

  <sup>Canada Fork Only</sup>

View it on GitHub [72139bea3...14a9635d8]

  Changes

• Released Python 3 compatible code.

  <sup>Canada Fork Only</sup>

View it on GitHub [b3fd804a1...b9e853203]

  Features

• Added new link to the Open Map viewer page that links to the Google Analytics CKAN resource page for the maps that are currently being displayed.

  To enable the new link, set the RAMP_GA_RESOURCE_EN and RAMP_GA_RESOURCE_FR values in the Django settings file.

  Changes

• Added a new option to the Open Data search to allow reverse alphabetical sorting. At the same time now stripping white space from titles when indexing and also removed title capitalization styling on dataset titles.

View it on GitHub [9e4b75258...99f94d036]

  Features

• Upgrade core and contributed modules to Drupal 10

View it on GitHub [3837aae6d...71c02225e]

  Features

• Upgrade core and contributed modules to Drupal 10 for the open-government profile

View it on GitHub [dd9b7c70e...937d69d51]

  Bugfixes

• Fixed an issue with the datatable_field_headers block not having access to certain variables.

  <sup>Canada Fork Only</sup>

View it on GitHub [ee6e7b5cf...acc1a2986]

  Bugfixes

• Fixed the database trigger name for Question Period Notes NTR.

View it on GitHub [3508fcec8...6d9e428b6]

  Features

• Added new automated tests and simple documentation on running to Search

• Added new Django management console commands to make it easy to enable/disable searches

  Bugfixes

• Fixed missing hostname in the search query logs - automatically sets it now

View it on GitHub [a0e5ccfa5...9e4b75258]

  Changes

• Added new datatable_field_headers block to the datatables_view template.

  <sup>Canada Fork Only</sup>

• DataStore Dump endpoint no longer includes the _id field/column.

  <sup>Canada Fork Only</sup>

View it on GitHub [b96adaba0...ee6e7b5cf]

  Bugfixes

• Fixed an issue with the Organization Autocomplete endpoint not working properly.

View it on GitHub [590a63215...3508fcec8]

  Features

• Published Resources will now use the Recombinant Data Dictionary for the Datatables Views' column headers.

View it on GitHub [8034803c6...272082601]

  Features

• Added anonymous search term logging to the application. This will be used to identify trends in search and to areas for improvement in search results.

  Bugfixes

• Update the Record and Search Download pages to link directly to the parent search page. It was using the session variable, however this is not reliable if the end user has multiple web browser tabs open to multiple searches, switches languages or undertakes some action which can confuse the previous logic.

• The "More like this" results in the Open Data search had been reformatted to work with CKAN's dataset page. This returns just a basic HTML list. Search has been updated so then when users click on this link in the Open Data search results page they are shown the Search app's default well formatted More-like-this results page. CKAN will continue to receive the expected basic list.

View it on GitHub [a3dfa82bd...a0e5ccfa5]

  Changes

• Updated the Python requirements for the Solr Client project.

View it on GitHub [a70d3274b...822df1308]

  Features

• Publish new ATI Modernization Action Plan Tracker

View it on GitHub [aa4fe3194...2f56adda1]

  Bugfixes

• Catch NotAuthorized and NotFound in Dataset Feed view, returning 403 and 404 respectfully instead of hitting 500 server error.

  <sup>Canada Fork Only</sup>

  Removals

• Disabled unused Group routes.

  <sup>Canada Fork Only</sup>

View it on GitHub [07391c039...b96adaba0]

  Features

• Added test coverage for Validation into DataStore.

• Added test coverage for Xloader into DataStore.

• Organization and Group views need a user session to view on Registry.

• Recombinant (Proactive Disclosure) dataset types search pages need session to view on Registry. Following a direct link to a Recombinant dataset will redirect you to the correct Owner Organization for that type. The searches will redirect to the default Dataset search on Portal.

  Bugfixes

• Only Sysadmins can view the Admin index page.

• Fixed search facet for portal_release_date.

• Fixed an issue with the search facet dictionary resizing inside loops.

  Removals

• Removed old, unused Jinja2 macros.

• Remove the Suggest a Dataset status update link from Registry homepage

  Changes

• Improved HTML layouts and uniformity across search forms.

View it on GitHub [a07d6ce4e...590a63215]

  Bugfixes

• Catch NotAuthorized in view, returning 403 instead of hitting 500 server error.

  <sup>Canada Fork Only</sup>

View it on GitHub [569c5bc3c...c9f2f5fca]

  Features

• Leading and trailing white space now gets removed from cell values when loading into the DataStore.

  <sup>Canada Fork Only</sup>

• Ignore empty rows when loading into the DataStore.

  <sup>Backport</sup>

View it on GitHub [58b8c2fd3...e714cc0f2]