100 Commits
Author SHA1 Message Date
Henry Oswald fec359afac Merge pull request #162 from overleaf/ta-jpa-epipe-retry
[DockerRunner] retry container inspect on EPIPE
2020-05-19 11:15:25 +01:00
Henry Oswald 97f5691c87 Merge pull request #166 from overleaf/jpa-port-smoke-test-patch
[misc] simplify the smoke test and process shutdown
2020-05-19 10:31:32 +01:00
Henry Oswald 73afa1a8d7 Merge pull request #164 from overleaf/bg-fix-buffer-deprecations
fix deprecated usage of Buffer constructor
2020-05-19 10:26:56 +01:00
Henry Oswald 942678de38 Merge pull request #163 from overleaf/bg-use-encoding-on-process-output
set encoding when reading from streams
2020-05-19 10:26:26 +01:00
Henry Oswald 3834c37013 Merge pull request #165 from overleaf/ho-retry-url-downloads
add pipeUrlToFileWithRetry for file downloads
2020-05-19 10:25:19 +01:00
Henry Oswald a425412bdd Merge pull request #168 from overleaf/ho-dynamic-disk-size-checker-2
add refreshExpiryTimeout function
2020-05-19 10:25:12 +01:00
Henry Oswald 7254a025ae Merge pull request #146 from overleaf/bg-support-other-runtimes
support other runtimes
2020-04-23 14:42:18 +01:00
Henry Oswald b10f0ae9ad Merge pull request #158 from overleaf/jpa-entry-point-cleanup
[misc] entry point cleanup
2020-04-23 13:52:04 +01:00
Henry Oswald a4c64d7151 Merge pull request #155 from overleaf/ho-limit-lifespan
limit clsi lifespan via health checks and PROCESS_LIFE_SPAN_LIMIT_MS
2020-04-23 13:51:09 +01:00
Henry Oswald 3513748f73 add variance into shutdown time to avoid stampeed 2020-04-14 13:36:11 +01:00
Henry Oswald b445f7fb78 Merge branch 'master' of github.com:overleaf/clsi into ho-limit-lifespan 2020-03-31 09:52:37 +01:00
Henry Oswald 2e5e040475 limit clsi lifespan via health checks and PROCESS_LIFE_SPAN_LIMIT_MS 2020-03-20 13:37:58 +00:00
Henry Oswald 26122bef3a copy synctex over to /app/bin/synctex-mount in entrypoint 2020-03-11 11:06:46 +00:00
Henry Oswald 9fc13845a1 remove ./bin/install_texlive_gce.sh which shouldn't be needed
we shouldn't have needed this for a while, I think it is a cause of
startup delay, however this should have stopped other missing texlive
images in the past which is strange
2020-03-11 10:06:55 +00:00
Henry Oswald 31153c479c change console.log for logger.log 2019-03-22 20:42:26 +00:00
Henry Oswald 12fee9e4df add epoll_pwait to secomp profile
Last year golang changed from epoll_wait to epoll_pwait https://github.com/golang/go/issues/23750

This causes golang panic errors on mac when running secomp secure compiles using docker 18.09.1. It may start to become a problem on linux where we are running on 17.03.2-ce in production.
2019-01-24 12:30:37 +00:00
Henry Oswald 6fbdcd76d0 Merge pull request #110 from sharelatex/ho-increase-compile-size
pull clsi compile size limit into setting and bump to 7mb
2019-01-08 13:30:00 +00:00
Henry Oswald 541dac11cb pull clsi compile size limit into setting and bump to 7mb 2019-01-08 12:56:16 +00:00
Henry Oswald 75e77a3991 Merge pull request #103 from sharelatex/ho-mute-sentry-errors
have failed compiles warn rather than be an error
2018-11-28 22:35:51 +09:00
Henry Oswald 49f3b7d54f have failed compiles warn rather than be an error 2018-11-23 15:10:35 +00:00
Henry Oswald 7c4c8a9e44 remove debugging get settings function 2018-09-14 10:26:40 +01:00
Henry Oswald 77abf19f6b Merge pull request #86 from sharelatex/ho-dockerise
Dockerised clsi
2018-09-11 12:36:11 +01:00
Henry Oswald a781c7f600 change timeout test latex code 2018-09-11 11:34:25 +01:00
Henry Oswald b07b7a84be fix unit tests 2018-09-11 10:21:37 +01:00
Henry Oswald 58b4de905c Merge branch 'master' into ho-dockerise 2018-09-11 10:02:24 +01:00
Henry Oswald 5f9fb85613 bump wordcount timeouts, taken from 82b996b145 2018-09-11 09:55:10 +01:00
Henry Oswald d3bb863d0a improve synctex logging 2018-09-11 09:51:20 +01:00
Henry Oswald 6299832a13 don't error on a bad synctex call 2018-08-23 11:32:50 +01:00
Henry Oswald 607bb74ffa reduce log level 2018-08-23 11:16:28 +01:00
Henry Oswald b4107b7391 fse.ensureDir when running synctex and wordcount 2018-08-23 08:34:18 +01:00
Henry Oswald 5074442702 fix unit tests 2018-08-23 00:21:05 +01:00
Henry Oswald 05ddbd3a18 try changing bin to be owned by node 2018-08-23 00:10:06 +01:00
Henry Oswald 7b773474d9 improve error reporting 2018-08-23 00:00:43 +01:00
Henry Oswald e4d28addf9 change sync to async for lockfile debugging 2018-08-22 22:17:02 +01:00
Henry Oswald 171ad0329d fix sql query checking last access time 2018-08-22 18:21:15 +01:00
Henry Oswald 834eeffda4 add time secomp 2018-08-21 18:56:53 +01:00
Henry Oswald 0f179a7c7c add log on exited error code 2018-08-21 12:02:12 +01:00
Henry Oswald 1990f20dc0 improve error reporting 2018-08-20 10:12:32 +01:00
Henry Oswald 407c7c235b Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-08-19 11:46:11 +01:00
Henry Oswald 988f177f79 added loads of debugging 2018-08-19 11:38:27 +01:00
Henry Oswald eec0529ef7 put FILESTORE_PARALLEL_FILE_DOWNLOADS and
FILESTORE_PARALLEL_SQL_QUERY_LIMIT into env vars
2018-08-14 15:17:56 +01:00
Henry Oswald 95b2e8caae comment out erroring log for moment 2018-08-01 14:32:17 +01:00
Henry Oswald 3890cdec37 null check host options 2018-08-01 14:10:22 +01:00
Henry Oswald 3e3468d9e9 reduce logging 2018-08-01 13:59:09 +01:00
Henry Oswald 9ef9a3b780 make Settings.parallelSqlQueryLimit a config setting 2018-07-31 14:38:24 +01:00
Henry Oswald ee518c1755 fix expired projects command 2018-07-30 17:37:30 +01:00
Henry Oswald 3a9206f1e7 fix missing cb’s 2018-07-30 17:01:59 +01:00
Henry Oswald d1ce49d6d7 add db queue file for global db query queues 2018-07-30 16:46:47 +01:00
Henry Oswald 627bed428e added a queue with 1 concurency to db queries 2018-07-30 16:22:04 +01:00
Henry Oswald 92e1240635 added some debugging 2018-07-30 15:18:25 +01:00
Henry Oswald 94a52333f7 add sync= off and read_uncommited=true to improve perf 2018-07-30 15:16:06 +01:00
Henry Oswald c490479a1a remove some console.logs 2018-07-30 15:11:41 +01:00
Henry Oswald f802717cb5 remove password from clsi for sql
sequalise fails when it is set to null
2018-07-30 14:04:33 +01:00
Henry Oswald 0eeee4284d bump retried and package versions 2018-07-30 11:25:28 +01:00
Henry Oswald e1c23be845 Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-07-26 16:52:26 +01:00
Henry Oswald 67d34fdaf0 dd wal logging 2018-07-26 16:12:26 +01:00
Henry Oswald 2b6032b249 only set wal for sqlite 2018-07-17 12:53:07 +01:00
Henry Oswald 3478c28fa3 Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-07-17 12:52:18 +01:00
Henry Oswald 3e26efe06f add PRAGMA journal_mode=WAL; 2018-07-17 12:50:33 +01:00
Henry Oswald bcb87620b5 change override to leave image name so it works for wl_texlive 2018-07-16 17:25:14 +01:00
Henry Oswald dd015a05cb remove express header 2018-07-16 15:38:23 +01:00
Henry Oswald 8d846f64a9 move texliveImageNameOveride further down request so it works for
compile tests
2018-07-13 11:52:49 +01:00
Henry Oswald 3545852173 quick hack to overright image name further down stack 2018-07-13 11:46:37 +01:00
Henry Oswald 7fc9412141 Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-07-13 10:42:27 +01:00
Henry Oswald a960614eb4 added texliveImageNameOveride 2018-07-13 10:37:22 +01:00
Henry Oswald a75cec7d52 added maint down endpoint 2018-07-05 15:07:07 +01:00
Henry Oswald 6464aefdb4 added filestoreDomainOveride 2018-07-03 16:41:34 +01:00
Henry Oswald ec85957ae4 add load balance http endpoints to shut box down 2018-06-28 16:04:34 +01:00
Henry Oswald 4bfc02ef3b fix seccomp key 2018-06-26 15:38:30 +01:00
Henry Oswald 364c8097c8 add error catch to settings.defaults 2018-06-26 15:04:56 +01:00
Henry Oswald 911e1d58f7 put seccomp_profile_path into variable and try catch 2018-06-26 14:44:03 +01:00
Henry Oswald dd93d37460 added seccomp 2018-06-26 12:43:47 +01:00
Henry Oswald b30890ef99 remove the compile npm command, it isn't needed 2018-06-12 17:48:23 +01:00
Henry Oswald 926667f365 update build scripts so smoke tests are compiled 2018-06-12 17:44:13 +01:00
Henry Oswald f000ecb681 Merge branch 'master' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-06-08 19:21:18 +01:00
Henry Oswald 436f69f3a6 Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-05-25 15:33:08 +01:00
Henry Oswald 38e91ab3e4 bumped timeout to 30 seconds 2018-05-25 15:30:26 +01:00
Henry Oswald da814b0e3a log settings on startup 2018-05-25 12:01:16 +01:00
Henry Oswald e544ad9a23 set user to tex for tests run on ci box 2018-05-25 11:51:34 +01:00
Henry Oswald 1814f1c997 added --exit to unit tests 2018-05-24 21:59:02 +01:00
Henry Oswald 98a4e60eb7 update to 1.1.3 build scripts 2018-05-24 19:03:57 +01:00
Henry Oswald ca23cd42ad update package.json scripts 2018-04-09 11:06:35 +01:00
Henry Oswald b330ee2d5b grep works with command
updated build scripts
acceptence tests break, files are written as root when user is node
2018-03-29 17:07:22 +01:00
Henry Oswald b5a7eabaab update build script and add load balancer agent 2018-03-29 12:12:29 +01:00
Henry Oswald ec75f9fa67 add smoke test env var 2018-03-20 13:48:12 +00:00
Henry Oswald dc1ea9d3e9 ammend comment 2018-03-19 14:22:18 +00:00
Henry Oswald 4d955a8d41 try a build with node user 2018-03-19 14:10:45 +00:00
Henry Oswald 0915ac8c60 run as app user and chmod 777 compiles dir 2018-03-19 12:56:53 +00:00
Henry Oswald aeb6f48945 try running as root 2018-03-19 09:51:26 +00:00
Henry Oswald 8ccbfc7d32 don't put synctex in as a volume 2018-03-16 18:11:46 +00:00
Henry Oswald 0bd9377018 chown synctex and add the creation of directories in 2018-03-16 17:48:55 +00:00
Henry Oswald 3c1d7ab264 mkdir the /app/bin/synctex-mount 2018-03-16 17:40:10 +00:00
Henry Oswald 3d9a93ad61 add logging of docker options 2018-03-16 17:37:36 +00:00
Henry Oswald 17c51c2ba0 added debugging and new moving commands 2018-03-16 17:30:11 +00:00
Henry Oswald f4226ecd0e try copying synctex betwen directories 2018-03-16 17:10:56 +00:00
Henry Oswald 6fbfcfc68b move synctex into a directory for simple mounting 2018-03-16 16:50:30 +00:00
Henry Oswald 63145cc60c add synctex back in 2018-03-16 16:22:39 +00:00
Henry Oswald 5739a2aeca comment out synctex for moment 2018-03-16 16:04:26 +00:00
Henry Oswald 9f8a68be38 add log line for connecting to a db 2018-03-16 15:29:35 +00:00
Henry Oswald 1dce40c61f make compiles dir 2018-03-16 15:25:36 +00:00