# Continuous Integration and Automation Every change on the OpenIM repository, either made through a pull request or direct push, triggers the continuous integration pipelines defined within the same repository. Needless to say, all the OpenIM contributions can be merged until all the checks pass (AKA having green builds). - [Continuous Integration and Automation](#continuous-integration-and-automation) - [CI Platforms](#ci-platforms) - [GitHub Actions](#github-actions) - [Running locally](#running-locally) ## CI Platforms Currently, there are two different platforms involved in running the CI processes: - GitHub actions - Drone pipelines on CNCF infrastructure ### GitHub Actions All the existing GitHub Actions are defined as YAML files under the `.github/workflows` directory. These can be grouped into: - **PR Checks**. These actions run all the required validations upon PR creation and update. Covering the DCO compliance check, `x86_64` test batteries (unit, integration, smoke), and code coverage. - **Repository automation**. Currently, it only covers issues and epic grooming. Everything runs on GitHub's provided runners; thus, the tests are limited to run in `x86_64` architectures. ## Running locally A contributor should verify their changes locally to speed up the pull request process. Fortunately, all the CI steps can be on local environments, except for the publishing ones, through either of the following methods: **User Makefile:** ```bash root@PS2023EVRHNCXG:~/workspaces/openim/Open-IM-Server# make help ๐Ÿ˜Š Usage: make ... Targets: all Run tidy, gen, add-copyright, format, lint, cover, build ๐Ÿš€ build Build binaries by default ๐Ÿ› ๏ธ multiarch Build binaries for multiple platforms. See option PLATFORMS. ๐ŸŒ tidy tidy go.mod โœจ vendor vendor go.mod ๐Ÿ“ฆ style code style -> fmt,vet,lint ๐Ÿ’… fmt Run go fmt against code. โœจ vet Run go vet against code. โœ… lint Check syntax and styling of go sources. โœ”๏ธ format Gofmt (reformat) package sources (exclude vendor dir if existed). ๐Ÿ”„ test Run unit test. ๐Ÿงช cover Run unit test and get test coverage. ๐Ÿ“Š updates Check for updates to go.mod dependencies ๐Ÿ†• imports task to automatically handle import packages in Go files using goimports tool ๐Ÿ“ฅ clean Remove all files that are created by building. ๐Ÿ—‘๏ธ image Build docker images for host arch. ๐Ÿณ image.multiarch Build docker images for multiple platforms. See option PLATFORMS. ๐ŸŒ๐Ÿณ push Build docker images for host arch and push images to registry. ๐Ÿ“ค๐Ÿณ push.multiarch Build docker images for multiple platforms and push images to registry. ๐ŸŒ๐Ÿ“ค๐Ÿณ tools Install dependent tools. ๐Ÿงฐ gen Generate all necessary files. ๐Ÿงฉ swagger Generate swagger document. ๐Ÿ“– serve-swagger Serve swagger spec and docs. ๐Ÿš€๐Ÿ“š verify-copyright Verify the license headers for all files. โœ… add-copyright Add copyright ensure source code files have license headers. ๐Ÿ“„ release release the project ๐ŸŽ‰ help Show this help info. โ„น๏ธ help-all Show all help details info. โ„น๏ธ๐Ÿ“š Options: DEBUG Whether or not to generate debug symbols. Default is 0. โ“ BINS Binaries to build. Default is all binaries under cmd. ๐Ÿ› ๏ธ This option is available when using: make {build}(.multiarch) ๐Ÿงฐ Example: make build BINS="openim-api openim_cms_api". PLATFORMS Platform to build for. Default is linux_arm64 and linux_amd64. ๐ŸŒ This option is available when using: make {build}.multiarch ๐ŸŒ Example: make multiarch PLATFORMS="linux_s390x linux_mips64 linux_mips64le darwin_amd64 windows_amd64 linux_amd64 linux_arm64". V Set to 1 enable verbose build. Default is 0. ๐Ÿ“ ``` How to Use Makefile to Help Contributors Build Projects Quickly ๐Ÿ˜Š The `make help` command is a handy tool that provides useful information on how to utilize the Makefile effectively. By running this command, contributors will gain insights into various targets and options available for building projects swiftly. Here's a breakdown of the targets and options provided by the Makefile: **Targets ๐Ÿ˜ƒ** 1. `all`: This target runs multiple tasks like `tidy`, `gen`, `add-copyright`, `format`, `lint`, `cover`, and `build`. It ensures comprehensive project building. 2. `build`: The primary target that compiles binaries by default. It is particularly useful for creating the necessary executable files. 3. `multiarch`: A target that builds binaries for multiple platforms. Contributors can specify the desired platforms using the `PLATFORMS` option. 4. `tidy`: This target cleans up the `go.mod` file, ensuring its consistency. 5. `vendor`: A target that updates the project dependencies based on the `go.mod` file. 6. `style`: Checks the code style using tools like `fmt`, `vet`, and `lint`. It ensures a consistent coding style throughout the project. 7. `fmt`: Formats the code using the `go fmt` command, ensuring proper indentation and formatting. 8. `vet`: Runs the `go vet` command to identify common errors in the code. 9. `lint`: Validates the syntax and styling of Go source files using a linter. 10. `format`: Reformats the package sources using `gofmt`. It excludes the vendor directory if it exists. 11. `test`: Executes unit tests to ensure the functionality and stability of the code. 12. `cover`: Performs unit tests and calculates the test coverage of the code. 13. `updates`: Checks for updates to the project's dependencies specified in the `go.mod` file. 14. `imports`: Automatically handles import packages in Go files using the `goimports` tool. 15. `clean`: Removes all files generated during the build process, effectively cleaning up the project directory. 16. `image`: Builds Docker images for the host architecture. 17. `image.multiarch`: Similar to the `image` target, but it builds Docker images for multiple platforms. Contributors can specify the desired platforms using the `PLATFORMS` option. 18. `push`: Builds Docker images for the host architecture and pushes them to a registry. 19. `push.multiarch`: Builds Docker images for multiple platforms and pushes them to a registry. Contributors can specify the desired platforms using the `PLATFORMS` option. 20. `tools`: Installs the necessary tools or dependencies required by the project. 21. `gen`: Generates all the required files automatically. 22. `swagger`: Generates the swagger document for the project. 23. `serve-swagger`: Serves the swagger specification and documentation. 24. `verify-copyright`: Verifies the license headers for all project files. 25. `add-copyright`: Adds copyright headers to the source code files. 26. `release`: Releases the project, presumably for distribution. 27. `help`: Displays information about available targets and options. 28. `help-all`: Shows detailed information about all available targets and options. **Options ๐Ÿ˜„** 1. `DEBUG`: A boolean option that determines whether or not to generate debug symbols. The default value is 0 (false). 2. `BINS`: Specifies the binaries to build. By default, it builds all binaries under the `cmd` directory. Contributors can provide a list of specific binaries using this option. 3. `PLATFORMS`: Specifies the platforms to build for. The default platforms are `linux_arm64` and `linux_amd64`. Contributors can specify multiple platforms by providing a space-separated list of platform names. 4. `V`: A boolean option that enables verbose build output when set to 1 (true). The default value is 0 (false). With these targets and options in place, contributors can efficiently build projects using the Makefile. Happy coding! ๐Ÿš€๐Ÿ˜Š