|
4 months ago | |
---|---|---|
.. | ||
api | 6 months ago | |
conformance | 10 months ago | |
framework | 4 months ago | |
page | 6 months ago | |
performance | 10 months ago | |
rpc | 10 months ago | |
scalability | 10 months ago | |
upgrade | 10 months ago | |
web | 6 months ago | |
README.md | 6 months ago | |
e2e.go | 8 months ago | |
e2e_test.go | 8 months ago |
README.md
OpenIM End-to-End (E2E) Testing Module
Overview
This repository contains the End-to-End (E2E) testing suite for OpenIM, a comprehensive instant messaging platform. The E2E tests are designed to simulate real-world usage scenarios to ensure that all components of the OpenIM system are functioning correctly in an integrated environment.
The tests cover various aspects of the system, including API endpoints, chat services, web interfaces, and RPC components, as well as performance and scalability under different load conditions.
Directory Structure
❯ tree e2e
test/e2e/
├── conformance/ # Contains tests for verifying OpenIM API conformance
├── framework/ # Provides auxiliary code and libraries for building and running E2E tests
│ ├── config/ # Test configuration files and management
│ ├── ginkgowrapper/ # Functions wrapping the testing library for handling test failures and skips
│ └── helpers/ # Helper functions such as user creation, message sending, etc.
├── api/ # End-to-end tests for OpenIM API
├── chat/ # Tests for the business server (including login, registration, and other logic)
├── web/ # Tests for the web frontend (login, registration, message sending and receiving)
├── rpc/ # End-to-end tests for various RPC components
│ ├── auth/ # Tests for the authentication service
│ ├── conversation/ # Tests for conversation management
│ ├── friend/ # Tests for friend relationship management
│ ├── group/ # Tests for group management
│ └── message/ # Tests for message handling
├── scalability/ # Tests for the scalability of the OpenIM system
├── performance/ # Performance tests such as load testing and stress testing
└── upgrade/ # Tests for compatibility and stability during OpenIM upgrades
The E2E tests are organized into the following directory structure:
conformance/
: Contains tests to verify the conformance of OpenIM API implementations.framework/
: Provides helper code for constructing and running E2E tests using the Ginkgo framework.config/
: Manages test configurations and options.ginkgowrapper/
: Wrappers for Ginkgo'sFail
andSkip
functions to handle structured data panics.helpers/
: Utility functions for common test actions like user creation, message dispatching, etc.
api/
: E2E tests for the OpenIM API endpoints.chat/
: Tests for the chat service, including authentication, session management, and messaging logic.web/
: Tests for the web interface, including user interactions and information exchange.rpc/
: E2E tests for each of the RPC components.auth/
: Tests for the authentication service.conversation/
: Tests for conversation management.friend/
: Tests for friend relationship management.group/
: Tests for group management.message/
: Tests for message handling.
scalability/
: Tests for the scalability of the OpenIM system.performance/
: Performance tests, including load and stress tests.upgrade/
: Tests for the upgrade process of OpenIM, ensuring compatibility and stability.
Prerequisites
Since the deployment of OpenIM requires some components such as Mongo and Kafka, you should think a bit before using E2E tests
docker compose up -d
OR User kubernetes deployment
Before running the E2E tests, ensure that you have the following prerequisites installed:
- Docker
- Kubernetes
- Ginkgo test framework
- Go (version 1.19 or higher)
Configuration
Test configurations can be customized via the config/
directory. The configuration files are in YAML format and allow you to set parameters such as API endpoints, user credentials, and test data.
Running the Tests
To run a single test or set of tests, you'll need the Ginkgo tool installed on your machine:
ginkgo --help
--focus value
If set, ginkgo will only run specs that match this regular expression. Can be specified multiple times, values are ORed.
To run the entire suite of E2E tests, use the following command:
ginkgo -v --randomizeAllSpecs --randomizeSuites --failOnPending --cover --trace --race --progress
You can also run a specific test or group of tests by specifying the path to the test directory:
ginkgo -v ./test/e2e/chat
Or you can use Makefile to run the tests:
make test-e2e
Test Development
To contribute to the E2E tests:
- Clone the repository and navigate to the
test/e2e/
directory. - Create a new test file or modify an existing test to cover a new scenario.
- Write test cases using the Ginkgo BDD style, ensuring that they are clear and descriptive.
- Run the tests locally to ensure they pass.
- Submit a pull request with your changes.
Please refer to the CONTRIBUTING.md
file for more detailed instructions on contributing to the test suite.
Reporting Issues
If you encounter any issues while running the E2E tests, please open an issue on the GitHub repository with the following information:
Open issue: https://github.com/openimsdk/open-im-server/issues/new/choose, choose "Failing Test" template.
- A clear and concise description of the issue.
- Steps to reproduce the behavior.
- Relevant logs and test output.
- Any other context that could be helpful in troubleshooting.
Continuous Integration (CI)
The E2E test suite is integrated with CI, which runs the tests automatically on each code commit. The results are reported back to the pull request or commit to provide immediate feedback on the impact of the changes.
Contact
For any queries or assistance, please reach out to the OpenIM development team at support@openim.com.