Skip to content

Instantly share code, notes, and snippets.

@alxschwarz
Last active June 27, 2017 05:45
Show Gist options
  • Save alxschwarz/e567e0c7062ae46bac58398921642f7a to your computer and use it in GitHub Desktop.
Save alxschwarz/e567e0c7062ae46bac58398921642f7a to your computer and use it in GitHub Desktop.
goofys with --debug_s3
2017/06/27 05:38:41.568429 s3.DEBUG DEBUG: Request s3/HeadObject Details:
---[ REQUEST POST-SIGN ]-----------------------------
HEAD /bucket/folder/ym%3D2017-01/ HTTP/1.1
Host: storage.googleapis.com
User-Agent: aws-sdk-go/1.8.25 (go1.8.1; linux; amd64)
Authorization: AWS4-HMAC-SHA256 Credential=GOOGM3WZIEPV54Q7BHJC/20170627/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=22a83bedb46412cbfce8f8b7e6721b187a897c55fccba0d7da34fc97f894fa39
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20170627T053841Z
-----------------------------------------------------
2017/06/27 05:38:41.568434 s3.DEBUG DEBUG: Request s3/ListObjects Details:
---[ REQUEST POST-SIGN ]-----------------------------
GET /bucket?delimiter=%2F&max-keys=1&prefix=folder%2Fym%3D2017-01%2F HTTP/1.1
Host: storage.googleapis.com
User-Agent: aws-sdk-go/1.8.25 (go1.8.1; linux; amd64)
Authorization: AWS4-HMAC-SHA256 Credential=GOOGM3WZIEPV54Q7BHJC/20170627/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=d117048c9691e65178525114d743a6bd172ae776c9697643f55cd9422d0df060
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20170627T053841Z
Accept-Encoding: gzip
-----------------------------------------------------
2017/06/27 05:38:41.568556 s3.DEBUG DEBUG: Request s3/HeadObject Details:
---[ REQUEST POST-SIGN ]-----------------------------
HEAD /bucket/folder/ym%3D2017-01 HTTP/1.1
Host: storage.googleapis.com
User-Agent: aws-sdk-go/1.8.25 (go1.8.1; linux; amd64)
Authorization: AWS4-HMAC-SHA256 Credential=GOOGM3WZIEPV54Q7BHJC/20170627/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=5b4b4d2565a1839b09f8a83d7da41af5984bc37cd3b9d2406745a3a6001c9c30
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20170627T053841Z
-----------------------------------------------------
2017/06/27 05:38:41.622401 s3.DEBUG DEBUG: Response s3/ListObjects Details:
---[ RESPONSE ]--------------------------------------
HTTP/2.0 200 OK
Content-Length: 398
Cache-Control: private, max-age=0
Content-Type: application/xml; charset=UTF-8
Date: Tue, 27 Jun 2017 05:38:41 GMT
Expires: Tue, 27 Jun 2017 05:38:41 GMT
Server: UploadServer
X-Goog-Metageneration: 8
X-Guploader-Uploadid: AEnB2UqO2X5GgxGS1IJZDDQF3gAkliNrXINXWHBc4yk0jQUi1uHkBxWJIV6shL8yrmpy4ArMzUDguY3tnVXyQce6aVLKmpJnaNs6erLV6Vs9N6fbBlS0Z6U
-----------------------------------------------------
2017/06/27 05:38:41.622467 s3.DEBUG {
CommonPrefixes: [{
Prefix: "folder/ym=2017-01/dd=08/"
}],
Delimiter: "/",
IsTruncated: true,
Marker: "",
MaxKeys: 1,
Name: "bucket",
NextMarker: "folder/ym=2017-01/dd=08/",
Prefix: "folder/ym=2017-01/"
}
2017/06/27 05:38:41.623490 s3.DEBUG DEBUG: Request s3/GetObject Details:
---[ REQUEST POST-SIGN ]-----------------------------
GET /bucket/folder/ym%3D2017-01/dd%3D15/merged-out-0499.lst HTTP/1.1
Host: storage.googleapis.com
User-Agent: aws-sdk-go/1.8.25 (go1.8.1; linux; amd64)
Accept-Encoding: identity
Authorization: AWS4-HMAC-SHA256 Credential=GOOGM3WZIEPV54Q7BHJC/20170627/us-east-1/s3/aws4_request, SignedHeaders=accept-encoding;host;x-amz-content-sha256;x-amz-date, Signature=37144366e21071264efd077c4fc827c9cfc820de8593fd683dbb22353684b0b4
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20170627T053841Z
-----------------------------------------------------
2017/06/27 05:38:41.628344 s3.DEBUG DEBUG: Response s3/HeadObject Details:
---[ RESPONSE ]--------------------------------------
HTTP/2.0 404 Not Found
Content-Length: 127
Cache-Control: private, max-age=0
Content-Type: application/xml; charset=UTF-8
Date: Tue, 27 Jun 2017 05:38:41 GMT
Expires: Tue, 27 Jun 2017 05:38:41 GMT
Server: UploadServer
X-Guploader-Uploadid: AEnB2Uoy09ZE0jxyyPERXVLs41Z2-SOUi7heDXI7CLftgfp3qFo_tlBj7ttPAMuZMNdDM5pNUS0rNyxQwU9xa8jxQAm5loUdWg
-----------------------------------------------------
2017/06/27 05:38:41.628383 s3.DEBUG DEBUG: Validate Response s3/HeadObject failed, not retrying, error NotFound: Not Found
status code: 404, request id: , host id:
2017/06/27 05:38:41.628976 s3.DEBUG DEBUG: Response s3/HeadObject Details:
---[ RESPONSE ]--------------------------------------
HTTP/2.0 404 Not Found
Content-Length: 127
Cache-Control: private, max-age=0
Content-Type: application/xml; charset=UTF-8
Date: Tue, 27 Jun 2017 05:38:41 GMT
Expires: Tue, 27 Jun 2017 05:38:41 GMT
Server: UploadServer
X-Guploader-Uploadid: AEnB2UqUIgf0dJ_VeWRilqFW8yUvNKRvtjtf_m7qmDzgnecVAy8KaXVM58mp8zx7JDjVJk64efpyIEydBWLI0Umu4ZHnQCmsrra5Yh3QKJDWuLheE3mSkV0
-----------------------------------------------------
2017/06/27 05:38:41.629005 s3.DEBUG DEBUG: Validate Response s3/HeadObject failed, not retrying, error NotFound: Not Found
status code: 404, request id: , host id:
2017/06/27 05:38:41.645365 s3.DEBUG DEBUG: Response s3/GetObject Details:
---[ RESPONSE ]--------------------------------------
HTTP/2.0 403 Forbidden
Content-Length: 395
Cache-Control: private, max-age=0
Content-Type: application/xml; charset=UTF-8
Date: Tue, 27 Jun 2017 05:38:41 GMT
Expires: Tue, 27 Jun 2017 05:38:41 GMT
Server: UploadServer
X-Guploader-Uploadid: AEnB2Upbvkx1gpTfvOI-2DNsFeEVpJjWt6EQw1S3_3PGfrifw2swa9RcWHIJ3mlXkDU0PxJVmCDEE3UN80kYm8jB_vWOonwi4g
-----------------------------------------------------
2017/06/27 05:38:41.645412 s3.DEBUG DEBUG: Validate Response s3/GetObject failed, not retrying, error SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your Google secret key and signing method.
status code: 403, request id: , host id:
2017/06/27 05:38:41.646113 s3.DEBUG DEBUG: Request s3/GetObject Details:
---[ REQUEST POST-SIGN ]-----------------------------
GET /bucket/folder/ym%3D2017-01/dd%3D15/merged-out-0499.lst HTTP/1.1
Host: storage.googleapis.com
User-Agent: aws-sdk-go/1.8.25 (go1.8.1; linux; amd64)
Accept-Encoding: identity
Authorization: AWS4-HMAC-SHA256 Credential=GOOGM3WZIEPV54Q7BHJC/20170627/us-east-1/s3/aws4_request, SignedHeaders=accept-encoding;host;x-amz-content-sha256;x-amz-date, Signature=37144366e21071264efd077c4fc827c9cfc820de8593fd683dbb22353684b0b4
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20170627T053841Z
-----------------------------------------------------
2017/06/27 05:38:41.668685 s3.DEBUG DEBUG: Response s3/GetObject Details:
---[ RESPONSE ]--------------------------------------
HTTP/2.0 403 Forbidden
Content-Length: 395
Cache-Control: private, max-age=0
Content-Type: application/xml; charset=UTF-8
Date: Tue, 27 Jun 2017 05:38:41 GMT
Expires: Tue, 27 Jun 2017 05:38:41 GMT
Server: UploadServer
X-Guploader-Uploadid: AEnB2Uoq29kjLpFKTcnr61kBbyIaHvKZpIqlS8a-wRda2t_h33TK6UNjSro9ma1ZcQ483qi2LAYciw1IHKwHkNKPxVek4e1vzg
-----------------------------------------------------
2017/06/27 05:38:41.668734 s3.DEBUG DEBUG: Validate Response s3/GetObject failed, not retrying, error SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your Google secret key and signing method.
status code: 403, request id: , host id:
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment