Quantcast
Channel: Ask the FireCloud Team — GATK-Forum
Viewing all articles
Browse latest Browse all 1147

google says job is done but FC/cromwell don't know it is done?

$
0
0

I have a task that is "Running" (in FireCloud), .....

ClipReadsWF.CreateSequenceGroupingTSVHide
Call #1:
ID:operations/EMTjxKegKxiRwdyOoJGP8Vwg_eDe0bUCKg9wcm9kdWN0aW9uUXVldWU
Status:
Running
Started:02/03/2017 at 12:06:39 PM (33 minutes ago)
Ended:Pending...
Inputs:Show
Outputs:None
stdout:CreateSequenceGroupingTSV-stdout.log
stderr:CreateSequenceGroupingTSV-stderr.log
JES log:CreateSequenceGroupingTSV.log

...but is done according to Google....

wm8b1-75c:ClipReadsWork esalinas$ gcloud alpha genomics  operations describe operations/EMTjxKegKxiRwdyOoJGP8Vwg_eDe0bUCKg9wcm9kdWN0aW9uUXVldWU|head -20
done: true
metadata:
  '@type': type.googleapis.com/google.genomics.v1.OperationMetadata
  clientId: ''
  createTime: '2017-02-03T17:06:40Z'
  endTime: '2017-02-03T17:08:06Z'
  events:
  - description: start
    startTime: '2017-02-03T17:07:22.289751081Z'
  - description: pulling-image
    startTime: '2017-02-03T17:07:24.776778310Z'
  - description: localizing-files
    startTime: '2017-02-03T17:07:58.787590044Z'
  - description: running-docker
    startTime: '2017-02-03T17:08:02.422473479Z'
  - description: delocalizing-files
    startTime: '2017-02-03T17:08:03.123440248Z'
  - description: copied 1 file(s) to "..."
    startTime: '2017-02-03T17:08:04.806092942Z'
  - description: ok

According to Google it finished over 30 min ago. The task is expected to take no more than 5-6 minutes. According to google the "Running-docker" was from 8:02.42 to 8:03.12 (less than one minute).

The rc file is in the bucket with return code 0.

wm8b1-75c:ClipReadsWork esalinas$ gsutil cat gs://fc-7119068c-40f9-4960-9dee-1d73730e9c1c/8a728caf-ac74-4cc3-a9cf-8b9923cea80c/ClipReadsWF/4d081440-5949-4b66-afc9-b4cbece4f823/call-CreateSequenceGroupingTSV/CreateSequenceGroupingTSV-rc.txt
0

@dlivitz suggested to use the network tab of the chrome developer tools and he saw some info related to call-caching so he suspect that there is something going on with it that is causing the workflow to stall.

      "cache": {
        "allowResultReuse": true
      },
      "Effective call caching mode": "CallCachingOff",


Viewing all articles
Browse latest Browse all 1147

Trending Articles