Arm backend: Build reference model without tests

[tom-arm]

• Avoids a build error with some OS & clang configurations
• Made cmake options consistent

Change-Id: I16c3e9e9908c824d282b20791f14373a8d959b22

cc @digantdesai @SS-JIA @freddan80 @per @zingo @oscarandersson8218 @mansnils @Sebastian-Larsson @robell

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/17588

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 7 New Failures, 1 Cancelled Job

As of commit 5252d72 with merge base 1dffefd ():

NEW FAILURES - The following jobs have failed:

• pull / test-openvino-linux / linux-job (gh)
  RuntimeError: Command docker exec -t ef22f20d5fd8bbcf065aafcbd0872f5fe030ab299476cd862d34231b143229b0 /exec failed with exit code 1
• pull / test-samsung-models-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 9c3170f93d0aa22920f4a8f37aff83d07b581ead9ab7598863e72d548a5c1663 /exec failed with exit code 1
• pull / test-samsung-quantmodels-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 866485cb3e792c1b94b7b379a7b5663479587614ee0513fad33048d6163a7c34 /exec failed with exit code 1
• pull / unittest-arm-backend-with-no-deps (test_pytest_models_tosa) / linux-job (gh)
  RuntimeError: Command docker exec -t a3315d470915dfbb744971eecf1274e89aa377318f7a660838dbcd1419c78e8b /exec failed with exit code 1
• pull / unittest-arm-backend-with-no-deps (test_pytest_ops_tosa) / linux-job (gh)
  RuntimeError: Command docker exec -t 7e6c1e6e3abc3c9d5e5281c203785b08017f31985f99d0fc3f11e126e53a70da /exec failed with exit code 1
• trunk / test-arm-ootb-linux (run_ootb_tests_tosa) / linux-job (gh)
  RuntimeError: Command docker exec -t f03e3d7d80dbec6bf421683d1f7d77b1c25499d5e2abfd293ca2a719b6437028 /exec failed with exit code 1
• trunk / unittest-release / macos / macos-job (gh)
  export/tests/test_target_recipes.py::TestTargetRecipes::test_linear_model

CANCELLED JOB - The following job was cancelled. Please retry:

• periodic (gh)

This comment was automatically generated by Dr. CI and updates every 15 minutes.