You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
forgejo/integrations
zeripath bb0ff77e46
Share HTML template renderers and create a watcher framework (#20218)
The recovery, API, Web and package frameworks all create their own HTML
Renderers. This increases the memory requirements of Gitea
unnecessarily with duplicate templates being kept in memory.

Further the reloading framework in dev mode for these involves locking
and recompiling all of the templates on each load. This will potentially
hide concurrency issues and it is inefficient.

This PR stores the templates renderer in the context and stores this
context in the NormalRoutes, it then creates a fsnotify.Watcher
framework to watch files.

The watching framework is then extended to the mailer templates which
were previously not being reloaded in dev.

Then the locales are simplified to a similar structure.

Fix #20210 
Fix #20211
Fix #20217

Signed-off-by: Andrew Thornton <art27@cantab.net>
2 years ago
..
gitea-repositories-meta rm .sample hooks which aren't used (#19101) 2 years ago
migration-test Refactor legacy git init (#20376) 2 years ago
README.md Fix various typos of software names (#18083) 3 years ago
README_ZH.md upgrade postgres refrence to 14 (#19416) 2 years ago
admin_user_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_activitypub_person_test.go Share HTML template renderers and create a watcher framework (#20218) 2 years ago
api_admin_org_test.go format with gofumpt (#18184) 2 years ago
api_admin_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_branch_test.go Update HTTP status codes to modern codes (#18063) 2 years ago
api_comment_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_fork_test.go Fix "data race" in testlogger (#9159) 5 years ago
api_gpg_keys_test.go format with gofumpt (#18184) 2 years ago
api_helper_for_declarative_test.go Auto merge pull requests when all checks succeeded via API (#9307) 2 years ago
api_httpsig_test.go Implement http signatures support for the API (#17565) 2 years ago
api_issue_label_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_issue_milestone_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_issue_reaction_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_issue_stopwatch_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_issue_subscription_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_issue_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_issue_tracked_time_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_keys_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_nodeinfo_test.go Share HTML template renderers and create a watcher framework (#20218) 2 years ago
api_notification_test.go Move some files into models' sub packages (#20262) 2 years ago
api_oauth2_apps_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_org_test.go Remove dependent on session auth for api/v1 routers (#19321) 2 years ago
api_packages_composer_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_packages_conan_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_packages_container_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_packages_generic_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_packages_helm_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_packages_maven_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_packages_npm_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_packages_nuget_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_packages_pub_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_packages_pypi_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_packages_rubygems_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_packages_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_private_serv_test.go Fix the bug: deploy key with write access can not push (#19010) 2 years ago
api_pull_commits_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_pull_review_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_pull_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_releases_test.go Move some files into models' sub packages (#20262) 2 years ago
api_repo_archive_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_collaborator_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_edit_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_file_create_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_file_delete_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_file_get_test.go Add API to serve blob or LFS file content (#19689) 2 years ago
api_repo_file_helpers.go Propagate context and ensure git commands run in request context (#17868) 2 years ago
api_repo_file_update_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_get_contents_list_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_get_contents_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_git_blobs_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_git_commits_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_git_hook_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_git_notes_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_git_ref_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_git_tags_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_git_trees_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_languages_test.go Update HTTP status codes to modern codes (#18063) 2 years ago
api_repo_lfs_locks_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_lfs_migrate_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_lfs_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_raw_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_tags_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_teams_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_repo_topic_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_settings_test.go Make mirror feature more configurable (#16957) 3 years ago
api_team_test.go Fix SQL Query for `SearchTeam` (#20844) 2 years ago
api_team_user_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_token_test.go Move some files into models' sub packages (#20262) 2 years ago
api_user_email_test.go Don't panic on `ErrEmailInvalid` (#19441) 2 years ago
api_user_heatmap_test.go Move some files into models' sub packages (#20262) 2 years ago
api_user_org_perm_test.go Add `ContextUser` to http request context (#18798) 2 years ago
api_user_orgs_test.go Fix SQL Query for `SearchTeam` (#20844) 2 years ago
api_user_search_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
api_wiki_test.go Add API to get/edit wiki (#17278) 3 years ago
attachment_test.go Update HTTP status codes to modern codes (#18063) 2 years ago
auth_ldap_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
benchmarks_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
branches_test.go Make better use of i18n (#20096) 2 years ago
change_default_branch_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
cmd_keys_test.go format with gofumpt (#18184) 2 years ago
compare_test.go Allow default branch to be inferred on compare page (#17908) 3 years ago
cors_test.go Fix "data race" in testlogger (#9159) 5 years ago
create_no_session_test.go Share HTML template renderers and create a watcher framework (#20218) 2 years ago
csrf_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
delete_user_test.go Move issues related files into models/issues (#19931) 2 years ago
download_test.go A better go code formatter, and now `make fmt` can run in Windows (#17684) 3 years ago
dump_restore_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
editor_test.go Add more linters to improve code readability (#19989) 2 years ago
empty_repo_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
eventsource_test.go Move some files into models' sub packages (#20262) 2 years ago
explore_repos_test.go Fix "data race" in testlogger (#9159) 5 years ago
git_clone_wiki_test.go Unexport git.GlobalCommandArgs (#18376) 2 years ago
git_helper_for_declarative_test.go Remove `git.Command.Run` and `git.Command.RunInDir*` (#19280) 2 years ago
git_smart_http_test.go Update HTTP status codes to modern codes (#18063) 2 years ago
git_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
goget_test.go Refactor legacy `unknwon/com` package, improve golangci lint (#19284) 2 years ago
gpg_git_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
html_helper.go Frontend refactor, PascalCase to camelCase, remove unused code (#17365) 3 years ago
integration_test.go Share HTML template renderers and create a watcher framework (#20218) 2 years ago
issue_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
lfs_getobject_test.go Refactor legacy git init (#20376) 2 years ago
lfs_local_endpoint_test.go format with gofumpt (#18184) 2 years ago
links_test.go Remove tab/TabName usage where it's not needed (#19973) 2 years ago
migrate_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
mirror_pull_test.go Move some files into models' sub packages (#20262) 2 years ago
mirror_push_test.go Move some files into models' sub packages (#20262) 2 years ago
mssql.ini.tmpl Use new config options (#20125) 2 years ago
mysql.ini.tmpl Use new config options (#20125) 2 years ago
mysql8.ini.tmpl Use new config options (#20125) 2 years ago
nonascii_branches_test.go Add more linters to improve code readability (#19989) 2 years ago
oauth_test.go Add more linters to improve code readability (#19989) 2 years ago
org_count_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
org_test.go Fix SQL Query for `SearchTeam` (#20844) 2 years ago
pgsql.ini.tmpl Use new config options (#20125) 2 years ago
private-testing.key Use non-expiring key. (#17984) 3 years ago
privateactivity_test.go Move some files into models' sub packages (#20262) 2 years ago
pull_compare_test.go Fix "data race" in testlogger (#9159) 5 years ago
pull_create_test.go Update HTTP status codes to modern codes (#18063) 2 years ago
pull_merge_test.go Move some files into models' sub packages (#20262) 2 years ago
pull_review_test.go Fix "data race" in testlogger (#9159) 5 years ago
pull_status_test.go Change commit status icons to SVG (#20736) 2 years ago
pull_update_test.go Move some files into models' sub packages (#20262) 2 years ago
release_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
rename_branch_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
repo_activity_test.go format with gofumpt (#18184) 2 years ago
repo_branch_test.go Make better use of i18n (#20096) 2 years ago
repo_commits_search_test.go Make TestCreateBranch and TestRepoCommitsSearch less noisy (#13471) 4 years ago
repo_commits_test.go Change commit status icons to SVG (#20736) 2 years ago
repo_fork_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
repo_generate_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
repo_migrate_test.go Update HTTP status codes to modern codes (#18063) 2 years ago
repo_search_test.go Automatically pause queue if index service is unavailable (#15066) 2 years ago
repo_tag_test.go Move some files into models' sub packages (#20262) 2 years ago
repo_test.go Remove useless JS operation for relative time tooltips (#20756) 2 years ago
repo_topic_test.go Refactor CSRF protection modules, make sure CSRF tokens can be up-to-date. (#19337) 2 years ago
repo_watch_test.go Some repository refactors (#17950) 3 years ago
repofiles_delete_test.go Renamed ctx.User to ctx.Doer. (#19161) 2 years ago
repofiles_update_test.go Add latest commit's SHA to content response (#20398) 2 years ago
setting_test.go Update HTTP status codes to modern codes (#18063) 2 years ago
signin_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
signout_test.go Update HTTP status codes to modern codes (#18063) 2 years ago
signup_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
sqlite.ini.tmpl Use new config options (#20125) 2 years ago
ssh_key_test.go format with gofumpt (#18184) 2 years ago
testlogger.go Fix typo (#19889) 2 years ago
timetracking_test.go format with gofumpt (#18184) 2 years ago
user_avatar_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
user_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
version_test.go Fix "data race" in testlogger (#9159) 5 years ago
view_test.go Display SVG files as images instead of text (#14101) 4 years ago
webfinger_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago
xss_test.go Refactor AssertExistsAndLoadBean to use generics (#20797) 2 years ago

README.md

Integrations tests

Integration tests can be run with make commands for the appropriate backends, namely:

make test-mysql
make test-pgsql
make test-sqlite

Make sure to perform a clean build before running tests:

make clean build

Run all tests via local drone

drone exec --local --build-event "pull_request"

Run sqlite integrations tests

Start tests

make test-sqlite

Run MySQL integrations tests

Setup a MySQL database inside docker

docker run -e "MYSQL_DATABASE=test" -e "MYSQL_ALLOW_EMPTY_PASSWORD=yes" -p 3306:3306 --rm --name mysql mysql:latest #(just ctrl-c to stop db and clean the container)
docker run -p 9200:9200 -p 9300:9300 -e "discovery.type=single-node" --rm --name elasticsearch elasticsearch:7.6.0 #(in a second terminal, just ctrl-c to stop db and clean the container)

Start tests based on the database container

TEST_MYSQL_HOST=localhost:3306 TEST_MYSQL_DBNAME=test TEST_MYSQL_USERNAME=root TEST_MYSQL_PASSWORD='' make test-mysql

Run pgsql integrations tests

Setup a pgsql database inside docker

docker run -e "POSTGRES_DB=test" -p 5432:5432 --rm --name pgsql postgres:latest #(just ctrl-c to stop db and clean the container)

Start tests based on the database container

TEST_PGSQL_HOST=localhost:5432 TEST_PGSQL_DBNAME=test TEST_PGSQL_USERNAME=postgres TEST_PGSQL_PASSWORD=postgres make test-pgsql

Run mssql integrations tests

Setup a mssql database inside docker

docker run -e "ACCEPT_EULA=Y" -e "MSSQL_PID=Standard" -e "SA_PASSWORD=MwantsaSecurePassword1" -p 1433:1433 --rm --name mssql microsoft/mssql-server-linux:latest #(just ctrl-c to stop db and clean the container)

Start tests based on the database container

TEST_MSSQL_HOST=localhost:1433 TEST_MSSQL_DBNAME=gitea_test TEST_MSSQL_USERNAME=sa TEST_MSSQL_PASSWORD=MwantsaSecurePassword1 make test-mssql

Running individual tests

Example command to run GPG test:

For SQLite:

make test-sqlite#GPG

For other databases(replace mssql to mysql, mysql8 or pgsql):

TEST_MSSQL_HOST=localhost:1433 TEST_MSSQL_DBNAME=test TEST_MSSQL_USERNAME=sa TEST_MSSQL_PASSWORD=MwantsaSecurePassword1 make test-mssql#GPG

Setting timeouts for declaring long-tests and long-flushes

We appreciate that some testing machines may not be very powerful and the default timeouts for declaring a slow test or a slow clean-up flush may not be appropriate.

You can either:

  • Within the test ini file set the following section:
[integration-tests]
SLOW_TEST = 10s ; 10s is the default value
SLOW_FLUSH = 5S ; 5s is the default value
  • Set the following environment variables:
GITEA_SLOW_TEST_TIME="10s" GITEA_SLOW_FLUSH_TIME="5s" make test-sqlite