You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.

init.go 6.2 kB

Add single sign-on support via SSPI on Windows (#8463) * Add single sign-on support via SSPI on Windows * Ensure plugins implement interface * Ensure plugins implement interface * Move functions used only by the SSPI auth method to sspi_windows.go * Field SSPISeparatorReplacement of AuthenticationForm should not be required via binding, as binding will insist the field is non-empty even if another login type is selected * Fix breaking of oauth authentication on download links. Do not create new session with SSPI authentication on download links. * Update documentation for the new 'SPNEGO with SSPI' login source * Mention in documentation that ROOT_URL should contain the FQDN of the server * Make sure that Contexter is not checking for active login sources when the ORM engine is not initialized (eg. when installing) * Always initialize and free SSO methods, even if they are not enabled, as a method can be activated while the app is running (from Authentication sources) * Add option in SSPIConfig for removing of domains from logon names * Update helper text for StripDomainNames option * Make sure handleSignIn() is called after a new user object is created by SSPI auth method * Remove default value from text of form field helper Co-Authored-By: Lauris BH <lauris@nix.lv> * Remove default value from text of form field helper Co-Authored-By: Lauris BH <lauris@nix.lv> * Remove default value from text of form field helper Co-Authored-By: Lauris BH <lauris@nix.lv> * Only make a query to the DB to check if SSPI is enabled on handlers that need that information for templates * Remove code duplication * Log errors in ActiveLoginSources Co-Authored-By: Lauris BH <lauris@nix.lv> * Revert suffix of randomly generated E-mails for Reverse proxy authentication Co-Authored-By: Lauris BH <lauris@nix.lv> * Revert unneeded white-space change in template Co-Authored-By: Lauris BH <lauris@nix.lv> * Add copyright comments at the top of new files * Use loopback name for randomly generated emails * Add locale tag for the SSPISeparatorReplacement field with proper casing * Revert casing of SSPISeparatorReplacement field in locale file, moving it up, next to other form fields * Update docs/content/doc/features/authentication.en-us.md Co-Authored-By: guillep2k <18600385+guillep2k@users.noreply.github.com> * Remove Priority() method and define the order in which SSO auth methods should be executed in one place * Log authenticated username only if it's not empty * Rephrase helper text for automatic creation of users * Return error if more than one active SSPI auth source is found * Change newUser() function to return error, letting caller log/handle the error * Move isPublicResource, isPublicPage and handleSignIn functions outside SSPI auth method to allow other SSO methods to reuse them if needed * Refactor initialization of the list containing SSO auth methods * Validate SSPI settings on POST * Change SSPI to only perform authentication on its own login page, API paths and download links. Leave Toggle middleware to redirect non authenticated users to login page * Make 'Default language' in SSPI config empty, unless changed by admin * Show error if admin tries to add a second authentication source of type SSPI * Simplify declaration of global variable * Rebuild gitgraph.js on Linux * Make sure config values containing only whitespace are not accepted
5 years ago
4 years ago
4 years ago
Better logging (#6038) (#6095) * Panic don't fatal on create new logger Fixes #5854 Signed-off-by: Andrew Thornton <art27@cantab.net> * partial broken * Update the logging infrastrcture Signed-off-by: Andrew Thornton <art27@cantab.net> * Reset the skip levels for Fatal and Error Signed-off-by: Andrew Thornton <art27@cantab.net> * broken ncsa * More log.Error fixes Signed-off-by: Andrew Thornton <art27@cantab.net> * Remove nal * set log-levels to lowercase * Make console_test test all levels * switch to lowercased levels * OK now working * Fix vetting issues * Fix lint * Fix tests * change default logging to match current gitea * Improve log testing Signed-off-by: Andrew Thornton <art27@cantab.net> * reset error skip levels to 0 * Update documentation and access logger configuration * Redirect the router log back to gitea if redirect macaron log but also allow setting the log level - i.e. TRACE * Fix broken level caching * Refactor the router log * Add Router logger * Add colorizing options * Adjust router colors * Only create logger if they will be used * update app.ini.sample * rename Attribute ColorAttribute * Change from white to green for function * Set fatal/error levels * Restore initial trace logger * Fix Trace arguments in modules/auth/auth.go * Properly handle XORMLogger * Improve admin/config page * fix fmt * Add auto-compression of old logs * Update error log levels * Remove the unnecessary skip argument from Error, Fatal and Critical * Add stacktrace support * Fix tests * Remove x/sync from vendors? * Add stderr option to console logger * Use filepath.ToSlash to protect against Windows in tests * Remove prefixed underscores from names in colors.go * Remove not implemented database logger This was removed from Gogs on 4 Mar 2016 but left in the configuration since then. * Ensure that log paths are relative to ROOT_PATH * use path.Join * rename jsonConfig to logConfig * Rename "config" to "jsonConfig" to make it clearer * Requested changes * Requested changes: XormLogger * Try to color the windows terminal If successful default to colorizing the console logs * fixup * Colorize initially too * update vendor * Colorize logs on default and remove if this is not a colorizing logger * Fix documentation * fix test * Use go-isatty to detect if on windows we are on msys or cygwin * Fix spelling mistake * Add missing vendors * More changes * Rationalise the ANSI writer protection * Adjust colors on advice from @0x5c * Make Flags a comma separated list * Move to use the windows constant for ENABLE_VIRTUAL_TERMINAL_PROCESSING * Ensure matching is done on the non-colored message - to simpify EXPRESSION
6 years ago
Better logging (#6038) (#6095) * Panic don't fatal on create new logger Fixes #5854 Signed-off-by: Andrew Thornton <art27@cantab.net> * partial broken * Update the logging infrastrcture Signed-off-by: Andrew Thornton <art27@cantab.net> * Reset the skip levels for Fatal and Error Signed-off-by: Andrew Thornton <art27@cantab.net> * broken ncsa * More log.Error fixes Signed-off-by: Andrew Thornton <art27@cantab.net> * Remove nal * set log-levels to lowercase * Make console_test test all levels * switch to lowercased levels * OK now working * Fix vetting issues * Fix lint * Fix tests * change default logging to match current gitea * Improve log testing Signed-off-by: Andrew Thornton <art27@cantab.net> * reset error skip levels to 0 * Update documentation and access logger configuration * Redirect the router log back to gitea if redirect macaron log but also allow setting the log level - i.e. TRACE * Fix broken level caching * Refactor the router log * Add Router logger * Add colorizing options * Adjust router colors * Only create logger if they will be used * update app.ini.sample * rename Attribute ColorAttribute * Change from white to green for function * Set fatal/error levels * Restore initial trace logger * Fix Trace arguments in modules/auth/auth.go * Properly handle XORMLogger * Improve admin/config page * fix fmt * Add auto-compression of old logs * Update error log levels * Remove the unnecessary skip argument from Error, Fatal and Critical * Add stacktrace support * Fix tests * Remove x/sync from vendors? * Add stderr option to console logger * Use filepath.ToSlash to protect against Windows in tests * Remove prefixed underscores from names in colors.go * Remove not implemented database logger This was removed from Gogs on 4 Mar 2016 but left in the configuration since then. * Ensure that log paths are relative to ROOT_PATH * use path.Join * rename jsonConfig to logConfig * Rename "config" to "jsonConfig" to make it clearer * Requested changes * Requested changes: XormLogger * Try to color the windows terminal If successful default to colorizing the console logs * fixup * Colorize initially too * update vendor * Colorize logs on default and remove if this is not a colorizing logger * Fix documentation * fix test * Use go-isatty to detect if on windows we are on msys or cygwin * Fix spelling mistake * Add missing vendors * More changes * Rationalise the ANSI writer protection * Adjust colors on advice from @0x5c * Make Flags a comma separated list * Move to use the windows constant for ENABLE_VIRTUAL_TERMINAL_PROCESSING * Ensure matching is done on the non-colored message - to simpify EXPRESSION
6 years ago
Add single sign-on support via SSPI on Windows (#8463) * Add single sign-on support via SSPI on Windows * Ensure plugins implement interface * Ensure plugins implement interface * Move functions used only by the SSPI auth method to sspi_windows.go * Field SSPISeparatorReplacement of AuthenticationForm should not be required via binding, as binding will insist the field is non-empty even if another login type is selected * Fix breaking of oauth authentication on download links. Do not create new session with SSPI authentication on download links. * Update documentation for the new 'SPNEGO with SSPI' login source * Mention in documentation that ROOT_URL should contain the FQDN of the server * Make sure that Contexter is not checking for active login sources when the ORM engine is not initialized (eg. when installing) * Always initialize and free SSO methods, even if they are not enabled, as a method can be activated while the app is running (from Authentication sources) * Add option in SSPIConfig for removing of domains from logon names * Update helper text for StripDomainNames option * Make sure handleSignIn() is called after a new user object is created by SSPI auth method * Remove default value from text of form field helper Co-Authored-By: Lauris BH <lauris@nix.lv> * Remove default value from text of form field helper Co-Authored-By: Lauris BH <lauris@nix.lv> * Remove default value from text of form field helper Co-Authored-By: Lauris BH <lauris@nix.lv> * Only make a query to the DB to check if SSPI is enabled on handlers that need that information for templates * Remove code duplication * Log errors in ActiveLoginSources Co-Authored-By: Lauris BH <lauris@nix.lv> * Revert suffix of randomly generated E-mails for Reverse proxy authentication Co-Authored-By: Lauris BH <lauris@nix.lv> * Revert unneeded white-space change in template Co-Authored-By: Lauris BH <lauris@nix.lv> * Add copyright comments at the top of new files * Use loopback name for randomly generated emails * Add locale tag for the SSPISeparatorReplacement field with proper casing * Revert casing of SSPISeparatorReplacement field in locale file, moving it up, next to other form fields * Update docs/content/doc/features/authentication.en-us.md Co-Authored-By: guillep2k <18600385+guillep2k@users.noreply.github.com> * Remove Priority() method and define the order in which SSO auth methods should be executed in one place * Log authenticated username only if it's not empty * Rephrase helper text for automatic creation of users * Return error if more than one active SSPI auth source is found * Change newUser() function to return error, letting caller log/handle the error * Move isPublicResource, isPublicPage and handleSignIn functions outside SSPI auth method to allow other SSO methods to reuse them if needed * Refactor initialization of the list containing SSO auth methods * Validate SSPI settings on POST * Change SSPI to only perform authentication on its own login page, API paths and download links. Leave Toggle middleware to redirect non authenticated users to login page * Make 'Default language' in SSPI config empty, unless changed by admin * Show error if admin tries to add a second authentication source of type SSPI * Simplify declaration of global variable * Rebuild gitgraph.js on Linux * Make sure config values containing only whitespace are not accepted
5 years ago
123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202
  1. // Copyright 2016 The Gitea Authors. All rights reserved.
  2. // Use of this source code is governed by a MIT-style
  3. // license that can be found in the LICENSE file.
  4. package routers
  5. import (
  6. "context"
  7. "fmt"
  8. "strings"
  9. "time"
  10. "code.gitea.io/gitea/models"
  11. "code.gitea.io/gitea/models/migrations"
  12. "code.gitea.io/gitea/modules/auth/sso"
  13. "code.gitea.io/gitea/modules/cache"
  14. "code.gitea.io/gitea/modules/cron"
  15. "code.gitea.io/gitea/modules/decompression"
  16. "code.gitea.io/gitea/modules/eventsource"
  17. "code.gitea.io/gitea/modules/git"
  18. "code.gitea.io/gitea/modules/highlight"
  19. code_indexer "code.gitea.io/gitea/modules/indexer/code"
  20. issue_indexer "code.gitea.io/gitea/modules/indexer/issues"
  21. stats_indexer "code.gitea.io/gitea/modules/indexer/stats"
  22. "code.gitea.io/gitea/modules/log"
  23. "code.gitea.io/gitea/modules/markup"
  24. "code.gitea.io/gitea/modules/markup/external"
  25. "code.gitea.io/gitea/modules/notification"
  26. "code.gitea.io/gitea/modules/options"
  27. "code.gitea.io/gitea/modules/setting"
  28. "code.gitea.io/gitea/modules/ssh"
  29. "code.gitea.io/gitea/modules/storage"
  30. "code.gitea.io/gitea/modules/task"
  31. "code.gitea.io/gitea/modules/timer"
  32. "code.gitea.io/gitea/modules/webhook"
  33. "code.gitea.io/gitea/services/mailer"
  34. mirror_service "code.gitea.io/gitea/services/mirror"
  35. pull_service "code.gitea.io/gitea/services/pull"
  36. "gitea.com/macaron/i18n"
  37. "gitea.com/macaron/macaron"
  38. unknwoni18n "github.com/unknwon/i18n"
  39. )
  40. func checkRunMode() {
  41. switch setting.Cfg.Section("").Key("RUN_MODE").String() {
  42. case "prod":
  43. macaron.Env = macaron.PROD
  44. macaron.ColorLog = false
  45. setting.ProdMode = true
  46. default:
  47. git.Debug = true
  48. }
  49. log.Info("Run Mode: %s", strings.Title(macaron.Env))
  50. }
  51. // NewServices init new services
  52. func NewServices() {
  53. setting.NewServices()
  54. if err := storage.Init(); err != nil {
  55. log.Fatal("storage init failed: %v", err)
  56. }
  57. mailer.NewContext()
  58. _ = cache.NewContext()
  59. notification.NewContext()
  60. decompression.NewContext()
  61. }
  62. // In case of problems connecting to DB, retry connection. Eg, PGSQL in Docker Container on Synology
  63. func initDBEngine(ctx context.Context) (err error) {
  64. log.Info("Beginning ORM engine initialization.")
  65. for i := 0; i < setting.Database.DBConnectRetries; i++ {
  66. select {
  67. case <-ctx.Done():
  68. return fmt.Errorf("Aborted due to shutdown:\nin retry ORM engine initialization")
  69. default:
  70. }
  71. log.Info("ORM engine initialization attempt #%d/%d...", i+1, setting.Database.DBConnectRetries)
  72. if err = models.NewEngine(ctx, migrations.Migrate); err == nil {
  73. break
  74. } else if i == setting.Database.DBConnectRetries-1 {
  75. return err
  76. }
  77. log.Error("ORM engine initialization attempt #%d/%d failed. Error: %v", i+1, setting.Database.DBConnectRetries, err)
  78. log.Info("Backing off for %d seconds", int64(setting.Database.DBConnectBackoff/time.Second))
  79. time.Sleep(setting.Database.DBConnectBackoff)
  80. }
  81. models.HasEngine = true
  82. return nil
  83. }
  84. // InitLocales loads the locales
  85. func InitLocales() {
  86. localeNames, err := options.Dir("locale")
  87. if err != nil {
  88. log.Fatal("Failed to list locale files: %v", err)
  89. }
  90. localFiles := make(map[string][]byte)
  91. for _, name := range localeNames {
  92. localFiles[name], err = options.Locale(name)
  93. if err != nil {
  94. log.Fatal("Failed to load %s locale file. %v", name, err)
  95. }
  96. }
  97. i18n.I18n(i18n.Options{
  98. SubURL: setting.AppSubURL,
  99. Files: localFiles,
  100. Langs: setting.Langs,
  101. Names: setting.Names,
  102. DefaultLang: "en-US",
  103. Redirect: false,
  104. CookieDomain: setting.SessionConfig.Domain,
  105. })
  106. }
  107. // GlobalInit is for global configuration reload-able.
  108. func GlobalInit(ctx context.Context) {
  109. setting.NewContext()
  110. if err := git.Init(ctx); err != nil {
  111. log.Fatal("Git module init failed: %v", err)
  112. }
  113. setting.CheckLFSVersion()
  114. log.Trace("AppPath: %s", setting.AppPath)
  115. log.Trace("AppWorkPath: %s", setting.AppWorkPath)
  116. log.Trace("Custom path: %s", setting.CustomPath)
  117. log.Trace("Log path: %s", setting.LogRootPath)
  118. // Setup i18n
  119. InitLocales()
  120. log.Info("%s", unknwoni18n.Tr("en-US", "admin.dashboard.delete_repo_archives"))
  121. NewServices()
  122. // Launch cron job after DB configured.
  123. if models.HasEngine {
  124. log.Info("%s", unknwoni18n.Tr("en-US", "admin.dashboard.start_cron_job"))
  125. go timer.LaunchCronJob()
  126. } else {
  127. if err := models.SetEngine(); err == nil {
  128. log.Info("%s", unknwoni18n.Tr("en-US", "admin.dashboard.start_cron_job"))
  129. go timer.LaunchCronJob()
  130. }
  131. }
  132. if setting.InstallLock {
  133. highlight.NewContext()
  134. external.RegisterParsers()
  135. markup.Init()
  136. if err := initDBEngine(ctx); err == nil {
  137. log.Info("ORM engine initialization successful!")
  138. } else {
  139. log.Fatal("ORM engine initialization failed: %v", err)
  140. }
  141. if err := models.InitOAuth2(); err != nil {
  142. log.Fatal("Failed to initialize OAuth2 support: %v", err)
  143. }
  144. models.NewRepoContext()
  145. // Booting long running goroutines.
  146. cron.NewContext()
  147. issue_indexer.InitIssueIndexer(false)
  148. code_indexer.Init()
  149. if err := stats_indexer.Init(); err != nil {
  150. log.Fatal("Failed to initialize repository stats indexer queue: %v", err)
  151. }
  152. mirror_service.InitSyncMirrors()
  153. webhook.InitDeliverHooks()
  154. if err := pull_service.Init(); err != nil {
  155. log.Fatal("Failed to initialize test pull requests queue: %v", err)
  156. }
  157. if err := task.Init(); err != nil {
  158. log.Fatal("Failed to initialize task scheduler: %v", err)
  159. }
  160. eventsource.GetManager().Init()
  161. }
  162. if setting.EnableSQLite3 {
  163. log.Info("SQLite3 Supported")
  164. }
  165. checkRunMode()
  166. // Now because Install will re-run GlobalInit once it has set InstallLock
  167. // we can't tell if the ssh port will remain unused until that's done.
  168. // However, see FIXME comment in install.go
  169. if setting.InstallLock {
  170. if setting.SSH.StartBuiltinServer {
  171. ssh.Listen(setting.SSH.ListenHost, setting.SSH.ListenPort, setting.SSH.ServerCiphers, setting.SSH.ServerKeyExchanges, setting.SSH.ServerMACs)
  172. log.Info("SSH server started on %s:%d. Cipher list (%v), key exchange algorithms (%v), MACs (%v)", setting.SSH.ListenHost, setting.SSH.ListenPort, setting.SSH.ServerCiphers, setting.SSH.ServerKeyExchanges, setting.SSH.ServerMACs)
  173. } else {
  174. ssh.Unused()
  175. }
  176. }
  177. if setting.InstallLock {
  178. sso.Init()
  179. }
  180. }