Builder linux_tsan2 Build 18644

Results:

Failure rtc_unittests

Trigger Info:

Project	webrtc
Revision	HEAD
Got Revision	26d0876814d74800d35809ba2e692da207f9dc91
Patch	Gerrit CL 122360 (ps#3)

Execution:

• Source: Task 42f6ea34972d6610
• Bot: trusty-webrtc-d2a17ac3-us-central1-b-c829
• Recipe: webrtc/standalone

Steps and Logfiles:

Show: Expanded Default Non-Green

1. ( 402 ms ) setup_build

   running recipe: "webrtc/standalone"
   • stdout
   • run_recipe
2. ( 1 secs ) gerrit fetch current CL info
   • stdout
   • json.output
3. ( 1 mins 11 secs ) bot_update

   [179GB/295GB used (60%)]
   • stdout
   • json.output
4. ( 115 ms ) ensure_goma
   • - no logs -
   1. ( 115 ms ) ensure_installed
      • stdout
      • json.output
5. ( 35 secs ) gclient runhooks
   • stdout
6. ( 1 secs ) swarming.py --version

   0.14
   • stdout
7. ( 1 secs ) clean isolated files
   • stdout
8. ( 521 ms ) lookup GN args

    

   dcheck_always_on = true

   ffmpeg_branding = "Chrome"

   is_clang = true

   is_debug = false

   is_tsan = true

   rtc_use_h264 = true

   target_cpu = "x64"

   use_goma = true

   goma_dir = "/b/s/w/ir/cache/goma/client"
   • stdout
9. ( 2 secs ) generate_build_files
   • stdout
   • swarming-targets-file.txt
10. ( 591 ms ) clang_revision
    • stdout
    • json.output
11. ( 4 secs ) preprocess_for_goma
    • - no logs -
    1. ( 472 ms ) goma cache directory
       • stdout
    2. ( 2 secs ) start_goma
       • stdout
       • cloudtail
    3. ( 1 secs ) start cloudtail
       • stdout
12. ( 27 secs ) compile
    • stdout
13. ( 201 ms ) compile confirm no-op
    • stdout
14. ( 12 secs ) postprocess_for_goma
    • - no logs -
    1. ( 481 ms ) goma_jsonstatus
       • stdout
       • json.output
    2. ( 477 ms ) goma_stat
       • stdout
    3. ( 481 ms ) stop_goma
       • stdout
    4. ( 10 secs ) upload_log
       • stdout
       • json.output
       • compiler_proxy_log
       • ninja_log
    5. ( 515 ms ) stop cloudtail
       • stdout
15. ( 8 secs ) isolate tests
    • stdout
    • json.output
16. ( 1 secs ) [trigger] audio_decoder_unittests

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
17. ( 835 ms ) [trigger] common_audio_unittests

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
18. ( 1 secs ) [trigger] common_video_unittests

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
19. ( 1 secs ) [trigger] low_bandwidth_audio_test

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
20. ( 1 secs ) [trigger] modules_tests

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
    • shard #1
21. ( 4 secs ) [trigger] modules_unittests

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
    • shard #1
    • shard #2
    • shard #3
    • shard #4
    • shard #5
22. ( 2 secs ) [trigger] peerconnection_unittests

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
    • shard #1
    • shard #2
    • shard #3
23. ( 1 secs ) [trigger] rtc_media_unittests

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
24. ( 1 secs ) [trigger] rtc_pc_unittests

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
25. ( 894 ms ) [trigger] rtc_stats_unittests

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
26. ( 2 secs ) [trigger] rtc_unittests

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
    • shard #1
    • shard #2
    • shard #3
    • shard #4
    • shard #5
27. ( 947 ms ) [trigger] slow_tests

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
28. ( 1 secs ) [trigger] system_wrappers_unittests

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
29. ( 1 secs ) [trigger] test_support_unittests

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
30. ( 1 secs ) [trigger] tools_unittests

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
31. ( 2 secs ) [trigger] video_engine_tests

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
    • shard #1
    • shard #2
    • shard #3
32. ( 986 ms ) [trigger] webrtc_nonparallel_tests

    Run on OS: 'Ubuntu-14.04'
    • stdout
    • json.output
    • shard #0
33. ( 267 ms ) ensure swarming
    • - no logs -
    1. ( 267 ms ) ensure_installed
       • stdout
       • json.output
34. ( 985 ms ) audio_decoder_unittests

    Run on OS: 'Ubuntu-14.04'

    Shard duration: 6s

    Total tests: 22

    * Passed: 22 (22 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 0 (0 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (1.8 sec) (deduped)
35. ( 1 secs ) Upload to test-results [audio_decoder_unittests]
    • stdout
36. ( 1 secs ) common_audio_unittests

    Run on OS: 'Ubuntu-14.04'

    Shard duration: 10s

    Total tests: 230

    * Passed: 230 (230 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 0 (0 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (5.2 sec) (deduped)
37. ( 1 secs ) Upload to test-results [common_audio_unittests]
    • stdout
38. ( 1 secs ) common_video_unittests

    Run on OS: 'Ubuntu-14.04'

    Shard duration: 6s

    Total tests: 78

    * Passed: 78 (78 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 0 (0 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (2.2 sec) (deduped)
39. ( 1 secs ) Upload to test-results [common_video_unittests]
    • stdout
40. ( 1 secs ) low_bandwidth_audio_test

    Run on OS: 'Ubuntu-14.04'

    Shard duration: 7s

    Total tests: 2

    * Passed: 2 (2 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 0 (0 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (3.0 sec) (deduped)
41. ( 1 secs ) Upload to test-results [low_bandwidth_audio_test]
    • stdout
42. ( 1 secs ) modules_tests

    Run on OS: 'Ubuntu-14.04'

    Max shard duration: 0:01:56.499791 (shard #1)

    Min shard duration: 0:01:15.711204 (shard #0)

    Total tests: 121

    * Passed: 121 (121 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 0 (0 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (61.2 sec) (deduped)
    • shard #1 isolated out
    • shard #1 (96.8 sec) (deduped)
43. ( 1 secs ) Upload to test-results [modules_tests]
    • stdout
44. ( 7 mins 39 secs ) modules_unittests

    Run on OS: 'Ubuntu-14.04'

    Max pending time: 0:05:24.939629 (shard #0)

    Max shard duration: 0:02:31.630822 (shard #3)

    Min shard duration: 0:02:10.356166 (shard #0)

    Total tests: 3494

    * Passed: 3494 (3494 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 0 (0 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (121.6 sec)
    • shard #1 isolated out
    • shard #1 (133.2 sec)
    • shard #2 isolated out
    • shard #2 (128.0 sec)
    • shard #3 isolated out
    • shard #3 (141.5 sec)
    • shard #4 isolated out
    • shard #4 (126.3 sec)
    • shard #5 isolated out
    • shard #5 (129.5 sec)
45. ( 12 secs ) Upload to test-results [modules_unittests]
    • stdout
46. ( 2 secs ) peerconnection_unittests

    Run on OS: 'Ubuntu-14.04'

    Max pending time: 0:05:22.646969 (shard #0)

    Max shard duration: 30s (shard #3)

    Min shard duration: 23s (shard #1)

    Total tests: 1539

    * Passed: 1539 (1539 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 0 (0 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (21.2 sec)
    • shard #1 isolated out
    • shard #1 (17.1 sec)
    • shard #2 isolated out
    • shard #2 (17.3 sec)
    • shard #3 isolated out
    • shard #3 (24.7 sec)
47. ( 8 secs ) Upload to test-results [peerconnection_unittests]
    • stdout
48. ( 1 secs ) rtc_media_unittests

    Run on OS: 'Ubuntu-14.04'

    Shard duration: 19s

    Total tests: 670

    * Passed: 670 (670 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 0 (0 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (14.4 sec) (deduped)
49. ( 4 secs ) Upload to test-results [rtc_media_unittests]
    • stdout
50. ( 1 secs ) rtc_pc_unittests

    Run on OS: 'Ubuntu-14.04'

    Pending time: 0:05:19.517301

    Shard duration: 11s

    Total tests: 509

    * Passed: 509 (509 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 0 (0 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (5.1 sec)
51. ( 3 secs ) Upload to test-results [rtc_pc_unittests]
    • stdout
52. ( 1 secs ) rtc_stats_unittests

    Run on OS: 'Ubuntu-14.04'

    Shard duration: 9s

    Total tests: 11

    * Passed: 11 (11 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 0 (0 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (4.3 sec) (deduped)
53. ( 1 secs ) Upload to test-results [rtc_stats_unittests]
    • stdout
54. ( 5 secs ) rtc_unittests

    Run on OS: 'Ubuntu-14.04'

    Max pending time: 0:05:19.606177 (shard #5)

    Max shard duration: 0:02:28.439997 (shard #0)

    Min shard duration: 0:02:24.208736 (shard #3)

    Total tests: 6940

    * Passed: 5787 (5787 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 1153 (1153 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (failed) (139.7 sec)
    • shard #1 isolated out
    • shard #1 (failed) (139.2 sec)
    • shard #2 isolated out
    • shard #2 (failed) (141.4 sec)
    • shard #3 isolated out
    • shard #3 (failed) (138.2 sec)
    • shard #4 isolated out
    • shard #4 (failed) (142.1 sec)
    • shard #5 isolated out
    • shard #5 (failed) (140.0 sec)
55. ( 29 secs ) Upload to test-results [rtc_unittests]
    • stdout
56. ( 1 secs ) slow_tests

    Run on OS: 'Ubuntu-14.04'

    Pending time: 0:05:19.014627

    Shard duration: 13s

    Total tests: 15

    * Passed: 15 (15 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 0 (0 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (6.6 sec)
57. ( 1 secs ) Upload to test-results [slow_tests]
    • stdout
58. ( 1 secs ) system_wrappers_unittests

    Run on OS: 'Ubuntu-14.04'

    Shard duration: 7s

    Total tests: 41

    * Passed: 41 (41 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 0 (0 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (2.1 sec) (deduped)
59. ( 1 secs ) Upload to test-results [system_wrappers_unittests]
    • stdout
60. ( 1 secs ) test_support_unittests

    Run on OS: 'Ubuntu-14.04'

    Pending time: 0:05:18.919731

    Shard duration: 13s

    Total tests: 94

    * Passed: 94 (94 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 0 (0 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (8.0 sec)
61. ( 1 secs ) Upload to test-results [test_support_unittests]
    • stdout
62. ( 1 secs ) tools_unittests

    Run on OS: 'Ubuntu-14.04'

    Shard duration: 21s

    Total tests: 70

    * Passed: 70 (70 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 0 (0 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (14.0 sec) (deduped)
63. ( 1 secs ) Upload to test-results [tools_unittests]
    • stdout
64. ( 13 secs ) video_engine_tests

    Run on OS: 'Ubuntu-14.04'

    Max shard duration: 0:01:00.905332 (shard #0)

    Min shard duration: 47s (shard #1)

    Total tests: 968

    * Passed: 968 (968 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 0 (0 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (55.1 sec) (deduped)
    • shard #1 isolated out
    • shard #1 (40.3 sec) (deduped)
    • shard #2 isolated out
    • shard #2 (45.7 sec) (deduped)
    • shard #3 isolated out
    • shard #3 (47.4 sec) (deduped)
65. ( 4 secs ) Upload to test-results [video_engine_tests]
    • stdout
66. ( 950 ms ) webrtc_nonparallel_tests

    Run on OS: 'Ubuntu-14.04'

    Shard duration: 16s

    Total tests: 74

    * Passed: 74 (74 expected, 0 unexpected)

    * Skipped: 0 (0 expected, 0 unexpected)

    * Failed: 0 (0 expected, 0 unexpected)

    * Flaky: 0 (0 expected, 0 unexpected)

     
    • stdout
    • json.output
    • swarming.summary
    • Merge script log
    • outdir_json
    • step_metadata
    • shard #0 isolated out
    • shard #0 (10.3 sec) (deduped)
67. ( 1 secs ) Upload to test-results [webrtc_nonparallel_tests]
    • stdout
68. ( 1 ms ) Failure reason
    • reason

Build Properties:

Name	Value	Source
$recipe_engine/buildbucket	{"build": {"builder": {"bucket": "try", "builder": "linux_tsan2", "project": "webrtc"}, "createTime": "2019-02-11T19:46:21.497564Z", "createdBy": "user:5071639625-1lppvbtck1morgivc6sq4dul7klu27sd@developer.gserviceaccount.com", "id": "8921790693466010112", "infra": {"buildbucket": {"serviceConfigRevision": "ef156230f5cd7f8c23f689fa4dc7f92742cd904d"}, "recipe": {"cipdPackage": "infra/recipe_bundles/chromium.googlesource.com/chromium/tools/build", "name": "webrtc/standalone"}, "swarming": {"hostname": "chromium-swarm.appspot.com"}}, "input": {"gerritChanges": [{"change": "122360", "host": "webrtc-review.googlesource.com", "patchset": "3", "project": "src"}]}, "number": 18644, "tags": [{"key": "builder", "value": "linux_tsan2"}, {"key": "buildset", "value": "patch/gerrit/webrtc-review.googlesource.com/122360/3"}, {"key": "cq_experimental", "value": "false"}, {"key": "user_agent", "value": "cq"}]}}	setup_build
$recipe_engine/path	{"cache_dir": "/b/s/w/ir/cache", "temp_dir": "/b/s/w/ir/tmp/rt"}	setup_build
$recipe_engine/runtime	{"is_experimental": false, "is_luci": true}	setup_build
attempt_start_ts	1549914358000000	setup_build
blamelist	["psla@webrtc.org"]	setup_build
bot_id	"trusty-webrtc-d2a17ac3-us-central1-b-c829"	setup_build
buildbucket	{"build": {"bucket": "luci.webrtc.try", "created_by": "user:5071639625-1lppvbtck1morgivc6sq4dul7klu27sd@developer.gserviceaccount.com", "created_ts": 1549914381497564, "id": "8921790693466010112", "project": "webrtc", "tags": ["build_address:luci.webrtc.try/linux_tsan2/18644", "builder:linux_tsan2", "buildset:patch/gerrit/webrtc-review.googlesource.com/122360/3", "cq_experimental:false", "user_agent:cq"]}, "hostname": "cr-buildbucket.appspot.com"}	setup_build
buildername	"linux_tsan2"	setup_build
buildnumber	18644	setup_build
category	"cq"	setup_build
mastername	"tryserver.webrtc"	setup_build
patch_gerrit_url	"https://webrtc-review.googlesource.com"	setup_build
patch_issue	122360	setup_build
patch_project	"src"	setup_build
patch_ref	"refs/changes/60/122360/3"	setup_build
patch_repository_url	"https://webrtc.googlesource.com/src"	setup_build
patch_set	3	setup_build
patch_storage	"gerrit"	setup_build
path_config	"generic"	setup_build
reason	"CQ"	setup_build
recipe	"webrtc/standalone"	setup_build
repository	"https://webrtc.googlesource.com/src"	setup_build
revision	"HEAD"	setup_build
got_revision	"26d0876814d74800d35809ba2e692da207f9dc91"	bot_update
got_revision_cp	"refs/heads/master@{#26639}"	bot_update
got_clang_revision	"353250-1"	clang_revision
isolate_server	"https://isolateserver.appspot.com"	isolate tests
swarm_hashes	{"audio_decoder_unittests": "a0f9466c5bfb2555c46d1891305971b27282a213", "common_audio_unittests": "e799bbd03bb96a3229ad665a41c6f5a5d586806e", "common_video_unittests": "25034297b5b025a6f895c51199e7b2edf720e42d", "low_bandwidth_audio_test": "38747e3c3e565c9bf24dec0e06b25b05b1ac1db4", "modules_tests": "ec91a0a58938c7a9fe3df48a65cb6c30ae4e36b6", "modules_unittests": "187777cc71bf10c2e3e31fc81c6e1eff202e2250", "peerconnection_unittests": "6c652f23148e21ff600a01abc8bcd92128d1b11a", "rtc_media_unittests": "e327fa37d57a5ec87682938730dfc584f3a4e052", "rtc_pc_unittests": "8a8d752568211dab1cf3cf26d63a32bed1ddfba5", "rtc_stats_unittests": "000fbacd7d0fe090d9502a9d8898245c6b4f87c5", "rtc_unittests": "0f6166522bf83b8c8d53fcd5e8b60ea5605b8cec", "slow_tests": "5104e76007171b89212765de21cbfcd97313577a", "system_wrappers_unittests": "1f1a57f5df9cdcf7ca43cb58bccfd38c58fcfe67", "test_support_unittests": "3aef40d350c9d9bd81defb5d34c2c472677cde73", "tools_unittests": "e6dfa4d6a59bbfe7208520ed04d584672b4c6edf", "video_engine_tests": "7205b64248c6344019c868e377a51f2caf71fd9f", "webrtc_nonparallel_tests": "934350dddf31654e861f77f61e5f170ff62e159a"}	isolate tests

Timing:

Create	Monday, 11-Feb-19 19:46:21 UTC
Start	Monday, 11-Feb-19 19:46:29 UTC
End	Monday, 11-Feb-19 19:59:43 UTC
Pending	7 secs
Execution	13 mins 14 secs