Repository navigation
Commit 47c2d0b
authored
CHORE: Flaky Setup + Optimization - Parallelize setup steps and reduce macOS CI job time (#723)
### Work Item / Issue Reference
>
[AB#47311](https://sqlclientdrivers.visualstudio.com/c6d89619-62de-46a0-8b46-70b92a84d85e/_workitems/edit/47311)
-------------------------------------------------------------------
### Summary
This pull request optimizes and streamlines the macOS test job in the
Azure DevOps pipeline. The main improvements focus on reducing setup
time, increasing reliability, and overlapping independent setup steps to
speed up the overall process. Notably, the setup for Colima and SQL
Server now runs in parallel with Python dependency installation and
build steps, and a pip package cache is introduced to avoid redundant
downloads between runs.
**Pipeline performance and reliability improvements:**
* Increased the `timeoutInMinutes` for the `PytestOnMacOS` job to 90
minutes to accommodate occasional long setup times and prevent premature
job termination.
* Added a pip package cache using the `Cache@2` task, significantly
reducing dependency installation time by persisting wheels between runs.
**Job step reorganization and parallelization:**
* Combined and refactored Homebrew installations into a single step to
avoid global lock delays and unnecessary updates, installing `cmake`,
`docker`, and `colima` together.
* Merged the Colima VM boot, SQL Server container setup, Python
dependency installation, and pybind build into a single script step,
running container setup in the background while building Python
dependencies and extensions in the foreground. This parallelization
hides setup latency and speeds up the job.
* Improved logging and error handling for the container setup, ensuring
failures are surfaced clearly and setup logs are displayed on error.1 parent 33e286f commit 47c2d0b
1 file changed
Lines changed: 95 additions & 49 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
461 | 461 | | |
462 | 462 | | |
463 | 463 | | |
| 464 | + | |
| 465 | + | |
| 466 | + | |
| 467 | + | |
| 468 | + | |
464 | 469 | | |
465 | 470 | | |
466 | 471 | | |
| 472 | + | |
| 473 | + | |
| 474 | + | |
| 475 | + | |
| 476 | + | |
| 477 | + | |
| 478 | + | |
467 | 479 | | |
468 | 480 | | |
469 | 481 | | |
| |||
482 | 494 | | |
483 | 495 | | |
484 | 496 | | |
485 | | - | |
486 | | - | |
487 | | - | |
| 497 | + | |
| 498 | + | |
| 499 | + | |
| 500 | + | |
| 501 | + | |
| 502 | + | |
| 503 | + | |
| 504 | + | |
| 505 | + | |
| 506 | + | |
| 507 | + | |
| 508 | + | |
| 509 | + | |
| 510 | + | |
| 511 | + | |
| 512 | + | |
| 513 | + | |
488 | 514 | | |
489 | | - | |
490 | | - | |
491 | | - | |
492 | | - | |
493 | | - | |
494 | | - | |
495 | | - | |
496 | | - | |
497 | | - | |
498 | | - | |
| 515 | + | |
| 516 | + | |
| 517 | + | |
| 518 | + | |
| 519 | + | |
| 520 | + | |
| 521 | + | |
| 522 | + | |
| 523 | + | |
| 524 | + | |
| 525 | + | |
| 526 | + | |
| 527 | + | |
| 528 | + | |
| 529 | + | |
| 530 | + | |
| 531 | + | |
| 532 | + | |
| 533 | + | |
| 534 | + | |
| 535 | + | |
| 536 | + | |
| 537 | + | |
| 538 | + | |
| 539 | + | |
| 540 | + | |
| 541 | + | |
| 542 | + | |
| 543 | + | |
| 544 | + | |
| 545 | + | |
| 546 | + | |
| 547 | + | |
| 548 | + | |
| 549 | + | |
| 550 | + | |
| 551 | + | |
| 552 | + | |
| 553 | + | |
| 554 | + | |
| 555 | + | |
| 556 | + | |
| 557 | + | |
| 558 | + | |
| 559 | + | |
| 560 | + | |
| 561 | + | |
| 562 | + | |
| 563 | + | |
| 564 | + | |
499 | 565 | | |
500 | | - | |
501 | | - | |
| 566 | + | |
| 567 | + | |
| 568 | + | |
502 | 569 | | |
503 | | - | |
504 | | - | |
505 | | - | |
506 | | - | |
| 570 | + | |
| 571 | + | |
| 572 | + | |
507 | 573 | | |
508 | | - | |
509 | | - | |
510 | | - | |
511 | | - | |
512 | | - | |
513 | | - | |
514 | | - | |
515 | | - | |
516 | | - | |
| 574 | + | |
| 575 | + | |
517 | 576 | | |
518 | | - | |
519 | | - | |
520 | | - | |
521 | | - | |
522 | | - | |
523 | | - | |
524 | | - | |
525 | | - | |
526 | | - | |
527 | | - | |
528 | | - | |
| 577 | + | |
| 578 | + | |
| 579 | + | |
| 580 | + | |
| 581 | + | |
| 582 | + | |
| 583 | + | |
| 584 | + | |
529 | 585 | | |
530 | 586 | | |
531 | 587 | | |
532 | | - | |
533 | | - | |
534 | | - | |
535 | | - | |
536 | | - | |
537 | | - | |
538 | | - | |
539 | | - | |
540 | | - | |
541 | | - | |
542 | 588 | | |
543 | 589 | | |
544 | 590 | | |
| |||
0 commit comments