Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Preservation audit stops on ssl timeout #6597

Closed
hackartisan opened this issue Jan 13, 2025 · 0 comments · Fixed by #6600
Closed

Preservation audit stops on ssl timeout #6597

hackartisan opened this issue Jan 13, 2025 · 0 comments · Fixed by #6600
Assignees
@hackartisan
Labels
preservation

Comments

@hackartisan
Copy link
Member

Summary or User Story

when preservation audit was resumed, we got the following backtrace:

#<Thread:0x00007fab0cf0ef10 /opt/figgy/shared/bundle/ruby/3.1.0/gems/lazily-0.2.1/lib/lazily/threading.rb:9 run> terminated with exception (report_on_exception is t[106/259]
/opt/figgy/shared/bundle/ruby/3.1.0/gems/httpclient-2.8.3/lib/httpclient/ssl_socket.rb:103:in `connect': SSL_connect returned=1 errno=0 peeraddr=142.250.176.219:443 state=er
ror: unexpected eof while reading (OpenSSL::SSL::SSLError)
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/httpclient-2.8.3/lib/httpclient/ssl_socket.rb:103:in `ssl_connect'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/httpclient-2.8.3/lib/httpclient/ssl_socket.rb:41:in `initialize'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/httpclient-2.8.3/lib/httpclient/ssl_socket.rb:26:in `new'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/httpclient-2.8.3/lib/httpclient/ssl_socket.rb:26:in `create_socket'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/httpclient-2.8.3/lib/httpclient/session.rb:752:in `block in connect'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/timeout-0.4.1/lib/timeout.rb:186:in `block in timeout'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/timeout-0.4.1/lib/timeout.rb:193:in `timeout'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/httpclient-2.8.3/lib/httpclient/session.rb:748:in `connect'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/httpclient-2.8.3/lib/httpclient/session.rb:511:in `query'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/httpclient-2.8.3/lib/httpclient/session.rb:177:in `query'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/httpclient-2.8.3/lib/httpclient.rb:1242:in `do_get_block'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/httpclient-2.8.3/lib/httpclient.rb:1019:in `block in do_request'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/httpclient-2.8.3/lib/httpclient.rb:1133:in `protect_keep_alive_disconnected'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/httpclient-2.8.3/lib/httpclient.rb:1014:in `do_request'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/httpclient-2.8.3/lib/httpclient.rb:1104:in `follow_redirect'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/httpclient-2.8.3/lib/httpclient.rb:854:in `request'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/google-apis-core-0.15.1/lib/google/apis/core/http_command.rb:318:in `execute_once'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/google-apis-core-0.15.1/lib/google/apis/core/http_command.rb:131:in `block (2 levels) in do_retry'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/retriable-3.1.2/lib/retriable.rb:61:in `block in retriable'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/retriable-3.1.2/lib/retriable.rb:56:in `times'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/retriable-3.1.2/lib/retriable.rb:56:in `retriable'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/google-apis-core-0.15.1/lib/google/apis/core/http_command.rb:128:in `block in do_retry'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/retriable-3.1.2/lib/retriable.rb:61:in `block in retriable'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/retriable-3.1.2/lib/retriable.rb:56:in `times'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/retriable-3.1.2/lib/retriable.rb:56:in `retriable'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/google-apis-core-0.15.1/lib/google/apis/core/http_command.rb:118:in `do_retry'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/google-apis-core-0.15.1/lib/google/apis/core/http_command.rb:109:in `execute'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/google-apis-core-0.15.1/lib/google/apis/core/base_service.rb:477:in `execute_or_queue_command'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/google-apis-storage_v1-0.17.0/lib/google/apis/storage_v1/service.rb:1773:in `get_object'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/google-cloud-storage-1.38.0/lib/google/cloud/storage/service.rb:389:in `block in get_file'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/google-cloud-storage-1.38.0/lib/google/cloud/storage/service.rb:770:in `execute'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/google-cloud-storage-1.38.0/lib/google/cloud/storage/service.rb:388:in `get_file'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/google-cloud-storage-1.38.0/lib/google/cloud/storage/bucket.rb:1328:in `file'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/shrine-google_cloud_storage-3.3.0/lib/shrine/storage/google_cloud_storage.rb:154:in `get_file'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/shrine-google_cloud_storage-3.3.0/lib/shrine/storage/google_cloud_storage.rb:107:in `exists?'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/valkyrie-shrine-1.0.0/lib/valkyrie/storage/shrine.rb:89:in `find_by'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/valkyrie-3.0.3/lib/valkyrie/storage_adapter.rb:43:in `find_by'
        from /opt/figgy/releases/20250110185640/app/services/preserver/preservation_checker.rb:50:in `preservation_file'
        from /opt/figgy/releases/20250110185640/app/services/preserver/preservation_checker.rb:29:in `preservation_file_exists?'
        from /opt/figgy/releases/20250110185640/app/services/preservation_status_reporter.rb:98:in `block in incorrectly_preserved?'
        from /opt/figgy/releases/20250110185640/app/services/preservation_status_reporter.rb:98:in `any?'
        from /opt/figgy/releases/20250110185640/app/services/preservation_status_reporter.rb:98:in `incorrectly_preserved?'
        from /opt/figgy/releases/20250110185640/app/services/preservation_status_reporter.rb:67:in `block (2 levels) in run_cloud_audit'
        from /opt/figgy/releases/20250110185640/app/services/preservation_status_reporter.rb:63:in `select'
        from /opt/figgy/releases/20250110185640/app/services/preservation_status_reporter.rb:63:in `block in run_cloud_audit'
        from /opt/figgy/shared/bundle/ruby/3.1.0/gems/lazily-0.2.1/lib/lazily/threading.rb:9:in `block (2 levels) in in_threads'

### Acceptance Criteria

This section can be completed by the DLS team. Some requirements to consider
including:

- [ ] The UI implemented for this issue meets accessibility requirements
- [ ] New functionality is documented


### First step

This section can be completed by the DLS team
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hackartisan hackartisan

Labels
preservation
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Use with_rescue to retry SSLErrors during preservation audit pulibrary/figgy
1 participant
@hackartisan