Connection Pooling, Split Tests, New Tests, Percona db added to tests #179
+23,173
−5,325
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Updated paths in docker-compose-tests.yaml to point to the new configuration files. - Enhanced example_config.yaml with connection pooling settings for MySQL. - Updated poetry.lock to reflect changes in dependencies and their configurations. - Added development dependencies in pyproject.toml for testing. - Improved pytest.ini with additional options and markers for better test categorization. - Removed obsolete configuration files and test scripts to streamline the project structure. - Enhanced GitHub Actions workflow for better test reporting and artifact handling.
- Changed `alwaysApply` setting in rules.mdc to false for better control. - Added optional `charset` and `collation` attributes in MysqlSettings for MariaDB compatibility. - Updated connection pooling to utilize standardized configuration in ConnectionPoolManager. - Refactored test suite structure, consolidating integration tests into focused modules for improved maintainability. - Enhanced README with updated test organization and execution instructions. - Added charset and collation settings in MariaDB test configuration for compatibility. - Removed obsolete integration test files to streamline the test suite.
- Introduced a new method `wait_for_condition` in BaseReplicationTest to wait for a specified condition with a timeout. - Updated multiple test cases in TestAdvancedProcessManagement to utilize `wait_for_condition` for ensuring replication starts before executing further commands. - Adjusted log reading to include the database name for better context in assertions.
- Simplified the log assertion in TestAdvancedProcessManagement by checking for the presence of "replication" directly in the logs string, improving readability and efficiency of the test.
…ss management, basic CRUD operations, and DDL scenarios - Deleted multiple integration test files that are no longer needed, including tests for advanced data types, process management, basic CRUD operations, DDL operations, and parallel replication scenarios. - This cleanup helps streamline the test suite and improve maintainability.
… API - Introduced a new Percona database service in `docker-compose-tests.yaml` with health checks and configuration settings. - Enhanced the `select` method in `ClickhouseApi` to support optional ordering and improved error handling. - Updated test documentation to include Percona-specific tests and configurations. - Refactored data handling methods in `DataTestMixin` for better SQL safety and consistency. - Improved data integrity tests with normalization and debugging information for better comparison between MySQL and ClickHouse. - Added new methods for verifying record existence and stability in the database.
- Added a critical requirement to always use `./run_tests.sh` for test verification in CLAUDE.md. - Refactored `get_clickhouse_count` method in DataTestMixin to improve record counting logic. - Updated test_ordering_guarantees.py to enhance transaction handling and replication checks, including more flexible timing and debugging information for better reliability in tests.
- Updated `docker-compose-tests.yaml` to improve Percona service configuration, including health checks and volume management. - Enhanced MySQL connection handling in `converter.py` to support additional bit types and improve type conversion logic. - Revised test documentation in `CLAUDE.md` to clarify testing procedures and address recent Percona container issues. - Refactored various integration tests to utilize context managers for MySQL connections, improving resource management and readability. - Adjusted data type tests to ensure proper handling of numeric boundaries and JSON data types, including updates to expected values and NULL handling.
… reporting - Added `pytest-html` version 4.1.1 and `pytest-json-report` version 1.5.0 to `requirements-dev.txt` to improve test output and reporting capabilities.
- Upgraded `docker/setup-buildx-action` to version 3 in both `release.yaml` and `tests.yaml` for improved Docker build capabilities. - Modified test reporting behavior in `tests.yaml` to always create comments for test results. - Refactored assertions in `base_replication_test.py` to improve clarity and reliability of condition checks. - Added new methods in `schema_test_mixin.py` for waiting on DDL replication and database creation. - Enhanced error handling in `test_advanced_ddl_operations.py` to better manage expected failures during DDL operations. - Adjusted dynamic column handling in `test_dynamic_column_handling.py` to prevent unnecessary database setup. - Improved state recovery checks in `test_advanced_process_management.py` to account for timing sensitivity in replication tests.
- Modified `get_tables` method in `ClickhouseApi` to accept an optional `database_name` parameter for improved table querying. - Updated query logic to ensure proper qualification of table names based on the current database context. - Enhanced `BaseReplicationTest` and related tests to set the ClickHouse database context explicitly, improving clarity and reliability in replication scenarios. - Added debugging information in tests to assist with table existence checks and database context verification.
- Updated `CLAUDE.md` to clarify the usage of the test script for full suite testing. - Enhanced `run_tests.sh` to accept optional pytest parameters, allowing for more flexible test execution. - Introduced a new method in `DataTestMixin` for normalizing datetime comparisons between MySQL and ClickHouse, improving accuracy in test assertions. - Refactored integration tests to ensure proper setup and teardown for MariaDB configurations, addressing known timing issues in replication tests.
…xecution - Introduced a new `PARALLEL_TESTING.md` file detailing the implementation of parallel test execution, achieving significant runtime reduction from 60-90 minutes to 10-15 minutes. - Updated `docker-compose-tests.yaml` to optimize health check parameters for the MySQL service. - Enhanced `pytest.ini` with new markers for parallel-safe and serial-only tests. - Modified `requirements-dev.txt` to include `pytest-xdist` for enabling parallel execution. - Refactored `run_tests.sh` to support parallel execution and CI reporting, allowing for flexible test runs with various options. - Improved test isolation in `conftest.py` to ensure unique database names for each test, preventing conflicts during parallel execution. - Updated integration tests to utilize the new parallel testing framework and ensure proper database context handling.
- Adjusted health check parameters in `docker-compose-tests.yaml` for the MySQL service to improve reliability during testing. - Added `pytest-xdist` version 3.8.0 to `requirements-dev.txt` and `pyproject.toml` to support parallel test execution. - Updated `requirements-dev.txt` to ensure compatibility with the latest testing frameworks. - Refactored test setup in `conftest.py` to ensure unique database names for improved isolation in tests. - Removed obsolete integration test files to streamline the test suite and enhance maintainability.
…el execution - Updated `.gitignore` to include patterns for binlog data directories to prevent clutter. - Enhanced `CLAUDE.md` with detailed testing architecture and critical fixes for parallel execution, including database isolation and connection pooling configurations. - Modified `Dockerfile` to ensure proper permissions for the binlog directory, addressing Docker volume mount issues. - Refactored `run_tests.sh` to support intelligent parallel execution and CI reporting, optimizing test runs. - Implemented critical directory creation logic in `config.py` to ensure binlog directory writability, preventing race conditions during parallel test execution. - Updated various test files to utilize the new `IsolatedBaseReplicationTest` for improved test isolation and reliability. - Cleaned up obsolete files in the `binlog_json_parser` directory to streamline the codebase.
- Deleted `test-report.html` and `test-results.xml` as they are no longer needed. - Updated `.gitignore` to include new patterns for `test-report.html` and `test-results.xml` to prevent future clutter.
- Added `.pytest_cache/` to `.gitignore` to prevent caching files from cluttering the repository.
|
Could you please split it into several PRs? Like tests separation - first PR, feature1 implementation - second PR, feature2 implementation 3d PR? Currently it's pretty hard to review so big PR. |
- Resolved database timing issues by implementing a complete dynamic database isolation system, allowing tests to run safely in parallel. - Enhanced `CLAUDE.md` with detailed descriptions of the new isolation features and centralized configuration management. - Updated `docker-compose-tests.yaml` for improved MySQL service configuration, including health checks and volume management. - Refactored `run_tests.sh` to include pre-test infrastructure monitoring and support for intelligent parallel execution. - Improved test setup in `conftest.py` to ensure unique database names and streamlined cleanup processes. - Removed the obsolete `PARALLEL_TESTING.md` file and integrated its content into existing documentation. - Updated various integration tests to utilize the new isolation framework and ensure proper database context handling.
…liability - Implemented a centralized TestIdManager to resolve subprocess isolation issues, resulting in a 4x improvement in test pass rate (from 18.8% to 69.9%). - Updated CLAUDE.md to reflect the new status and improvements in test infrastructure, including detailed descriptions of recent fixes and enhancements. - Refactored run_tests.sh to streamline test execution and improve performance monitoring. - Enhanced dynamic configuration management to ensure proper isolation and prevent database context issues during parallel execution. - Migrated several integration tests to utilize the enhanced configuration framework, ensuring better reliability and consistency in test results. - Improved error handling and logging in various test files to facilitate debugging and maintainability.
…n and configuration - Refactored `run_tests.sh` to change the phase of infrastructure monitoring to post-startup and removed redundant Docker service startup command. - Updated `rules.mdc` to set `alwaysApply` to false, enhancing configuration management for test execution. - Improved code readability and organization in `converter.py` by standardizing string quotes and optimizing import statements.
… and organization - Expanded .gitignore to include additional log files, environment variables, and editor-specific directories to prevent clutter in the repository. - Updated CLAUDE.md to reflect recent changes in test infrastructure, including detailed descriptions of fixes and enhancements related to test reliability and performance. - Refactored run_tests.sh to improve performance monitoring and streamline test execution processes. - Enhanced comments and documentation throughout the codebase to clarify the purpose and functionality of various components, ensuring better maintainability.
- Marked tasks for improving source code documentation and fixing critical process startup issues as done. - Updated the status of individual failing tests to in-progress. - Refactored test runners in `conftest.py` to use `python3` and absolute paths for better compatibility in container environments. - Added debug logging in `BaseReplicationTest` to improve error handling and visibility during test execution.
- Updated `docker-compose-tests.yaml` to create a named volume for binlog data and ensure proper permissions for the binlog directory. - Improved directory creation logic in `binlog_replicator.py` and `db_replicator.py` to handle missing parent directories more robustly. - Refactored integration tests in `test_basic_process_management.py` and `test_parallel_initial_replication.py` to utilize isolated configurations for better test isolation and reliability. - Updated task status in `tasks.json` to reflect progress in fixing individual failing tests.
- Standardized string formatting across command initialization in `runner.py` for better consistency. - Enhanced the structure of the `DbReplicatorRunner` class by using multi-line arguments for improved readability. - Updated logging messages in both `runner.py` and `utils.py` to use consistent string formatting. - Improved import organization in `runner.py` and `utils.py` for better clarity and maintainability. - Added helper methods in `base_replication_test.py` to streamline replication setup and target database creation in tests.
- Added detailed documentation to the `run` method in `ProcessRunner` to clarify the importance of test isolation during pytest execution. - Implemented critical checks to ensure test ID logic only runs in testing environments, preventing unnecessary warnings in production. - Improved comments to explain the rationale behind the test isolation system and its impact on database operations during parallel test execution.
- Updated CLAUDE.md to reflect current test status: 126 passed, 47 failed, 11 skipped (68.5% pass rate). - Implemented critical fixes for process startup reliability, including increased timeouts and enhanced error diagnostics. - Improved database detection logic to handle temporary and final database transitions more effectively. - Enhanced dynamic isolation features for parallel test execution, ensuring worker-specific database management. - Removed outdated documentation files and consolidated relevant information into existing guides for clarity.
…ocesses - Marked multiple tasks as done in tasks.json, reflecting the completion of test categorization and error handling improvements. - Enhanced directory creation logic in binlog_replicator.py and db_replicator.py to ensure robust handling of parent directories, preventing startup failures. - Improved error diagnostics and logging for directory creation to facilitate better debugging during test execution. - Removed outdated and flaky tests to streamline the test suite and improve overall reliability.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
I'm not trying to cause problems i swear 😂 i know this is as beast and we can schedule a call to go over it or whatever is needed.
I really needed connection pooling and the test file was insanely big 😂 and so i had to 'yak shave' 🪒 to get there.
Also for mariadb this adds in breaking changes as you must specify the charset and the collation for the connection pool to work. So we'd need to increment a major or minor version etc.
I'm working on fixing the build.