This document covers the process of testing your apps on beta operating systems, as well as what to do when encountering changes in your app's behavior in the process. APIs and programming languages can evolve from release-to-release, which creates a need to verify your software continues to work as expected. To perform this verification, Apple provides registered developers with early access to the revised operating system before it goes public. Changes in a given update of the operating system might effect your app, so taking the time to check can either give your app an advantage over the competition, or, create a bad user experience for your customers.
Definition of Terms
As a member of the Apple Beta Software Program, you'll be able to enroll your iPhone, iPad, iPod touch, Mac, Apple TV or Apple Watch to access the latest public betas, as well as subsequent updates, directly from iOS Software Update, the Mac App Store or tvOS Software Update. A large portion of this time was downloading the 'Install macOS Big Sur public beta' app—a 12.3GB download! Normally, installing the Parallels Tools in a new OS under development is a mistake. The Parallels Tools are individually designed for each guest OS. While it is possible, having the Tools for an older OS work in a newer OS is unusual. Mac OS 用エミュレータ Ver.2.3 beta EMU 624コメント; 227KB; 全部; 1-100; 最新50.
This document refers to the following relevant terms:
Operating System or OS, which encompasses all of the following: iOS, OS X, tvOS and watchOS.
Beta OS, Developer Preview, or Pre-Release refers to the advance access of Apple software given to developers for the purpose of verifying their third-party apps.
OS major revision refers to a pending new version of the operating system, for example, iOS 9.
GM Seed refers to a beta version of the operating system that is almost ready to go public. For example, the iOS 9 GM Seed is a version of iOS 9 beta that will most likely represent the first public version of iOS 9.
The GM version of the OS refers to the version of the OS that has gone public. For example, iOS 9 GM refers to the last GM Seed that was approved by Apple for release to the public.
Beta SDK refers to the Beta version of Xcode that includes a software development kit (SDK) matching the version number of the beta OS that you wish to test.
Summary of things to look for
The following is a categorization of the things you might encounter when testing your app on a beta OS release. These are the primary points of interest to look for when verifying your app works correctly in the new OS.
Framework Bugs
Framework bug reports should be filed early and often to give the best chance they can be fixed before the OS revision goes public.
Important: Discussing an issue on a Developer Forum is not a substitute for filling a bug report. Filing the bug first is a better way to ensure that a real framework bug can be diagnosed and fixed before the OS-update goes public.
• To file a bug report, use the Bug Reporter tool on the Apple developer website.
API or Language Evolution
Changes to your app can be required for various reasons, for example, due to deprecation or changes in API semantics. The earlier you identify these types of potential changes, the wider the development window is for implementation and testing.
- MacBook Pro / Mac OS X3. To test key mapping and gesture recording function via Mac OS X SnowL App4. Confirmed by Hans6.
- Operating System Release date Features 4.0 Beta 526.11.2 Mac OS X v10.4 - 10.5: June 11, 2008 First developer seed. Includes SquirrelFish JavaScript interpreter. Adds ability to save webpages as standalone web applications. Passes Acid3 test. 528.16 February 24, 2009 Version 4 Public Beta.
How to do it?
This section covers the required packages that must be downloaded and installed to begin testing your app on the beta.
The beta OS must be installed on your device (Mac, Apple TV, Apple Watch or iOS device). The beta OS, when offered, is available on the respective developer download page. For example, see iOS Downloads.
You must build and run your app using a version of Xcode that includes the beta SDK matching the version number of the OS you wish to test. Beta Xcode releases, when they are offered, are available on the Xcode Downloads developer webpage.
Important: Before installing the beta OS on your device, heed the warnings and recommendations made within the following sections of this document: Best Practices and Test Unique Customer Configurations to avoid any unexpected circumstances.
Best Practices
These are best practices to follow in general when testing your app on the beta.
Beta OS versions should be installed on a machine allocated specifically for testing. Since the purpose of pre-release access is to verify software runs correctly, it is not recommended to assume other production or mission-critical services that your business relies on will work as expected on the beta.
OS X-specific Best Practices
When upgrading from a beta to a build that isn't available from software update, you should always erase the drive/partition before you install the new beta.
Keep a copy of the previous operating system release running on a system for regression testing so that it can be cloned for use on a test system configured as an upgrade from the previous operating system release.
iOS, watchOS, tvOS Best Practices
Devices with an iOS beta installed may be restored to the current GM version of the OS, but they cannot be downgraded to the previous, non-beta, major OS version. See the Apple Support pages for more information.
Note: Plan your beta installation such that you still have other devices running the older OS. You will need the other devices for regression testing should you intend your app to deploy back to the older OS.
Be sure to back up your devices data using the latest version of iTunes or through iCloud backup prior to installing a beta. After installing the beta, you can restore device data through iTunes or iCloud backup.
Test Unique Customer Configurations
It is also important to be aware of the unique software configurations that your users may have. As an example, you should focus your efforts on the following software configurations:
Testing on the previous operating system.
Development and testing on the latest operating system your customers are using.
Project jumpius (ludum dare 33) mac os. Development and testing on the current beta.
OS X-specific recommendations
To test against these configurations it is recommended that you have at least three different external hard drives with the software configurations listed above installed on them. At a minimum, you can set up one drive that has three partitions with the above software configurations.
You should have at least one of each family of Macs (Macs with the same architecture, CPU, memory, graphics processor and so on) your customers are using to test each OS configuration against. If you can afford it, you should have one of each of the Macs your customers may have to test each OS configuration against.
iOS, watchOS, tvOS-specific recommendations
Maintain a collection of devices for testing each version of the OS your customers may have, and also test on beta releases that your customers don't have yet. Because devices updated to an iOS, tvOS, or watchOS version may not be restored to a previous OS, it requires you to have multiple similar devices to maintain the ability to test customer configurations that involve that a particular device running the older OS.
You should have at least one of each family of devices (devices that have the same architecture, 32-bit or 64-bit, screen resolution and PPI) for each OS major version your app aims to support. To avoid missing issues that might occur on a unique device configuration, you should own and test on e.
Note: At a minimum, you can test your iOS or watchOS apps Simulator. However, the simulator provides limited testing coverage and is not a substitute for real hardware with real memory and performance constraints.
What to do if your app behaves differently in the beta
Differences in behavior can result from a framework bug in the beta, or, a framework change that exposes a bug in your app's code. The following process should be used to distinguish between the two:
Isolate the issue into a minimal reproducible case. By removing code not necessary to reproduce the bug, the cause of the problem is often easier to find. If the issue looks like a framework bug, the sample code you created in the process can more easily be attached to a bug report which is critical to expediting its fix.
Issues with your app's code can be discussed on the Developer Forums: https://forums.developer.apple.com/ but remember to file a bug report for anything you think could be a framework issue.
For framework bugs:
Its just as important to include a runnable Xcode project that reproduces the problem as it is to clearly describe the issue using the Bug Reporter: http://developer.apple.com/bugreporter.
Note: Filing the bug report sooner rather than later gives the best chance at getting it fixed before the OS goes GM.
Use the Developer Forums to discuss potential workarounds for framework bugs in the event that a fix does not make the first public release: https://forums.developer.apple.com/.
Bugs that reproduce on the older, non-beta OS should be handled differently. Follow this process to deal with bugs that are present in a GM OS version:
Submit a bug report that mentions all OS versions the issue is present within, and also include a runnable Xcode project that reproduces the bug here: http://developer.apple.com/bugreporter.
Use the Developer Forums to discuss potential workarounds for framework bugs in the event that a fix does not make the first public release: https://forums.developer.apple.com/.
Submit a Developer Technical Support Incident to get help from Apple DTS: https://developer.apple.com/support/technical/.
Note: Apple DTS does not support issues that only occur in a beta OS. You must submit a bug report for issues that only occur in the beta using Bug Reporter as well as discuss the issue on the beta section of the Developer Forums.
Document Revision History
| Date | Notes |
|---|---|
| 2016-05-20 | Editorial update. |
| 2015-09-02 | Updated to include specific information about iOS, OS X and watchOS seeds. |
| 2012-03-09 | New document that covers the process of testing apps on beta pre-release Apple operating systems to catch early framework bugs or adapt to changes. |
Copyright © 2016 Apple Inc. All Rights Reserved. Terms of Use | Privacy Policy | Updated: 2016-05-20
Apple Beta Software Program
Help make the next releases of iOS, iPadOS, macOS, tvOS and watchOS our best yet. As a member of the Apple Beta Software Program, you can take part in shaping Apple software by test-driving pre-release versions and letting us know what you think.
Learn more about the next releases.
Already a member?Sign in
How do I participate?
As a member of the Apple Beta Software Program, you'll be able to enroll your devices to access the public betas and try out the latest features. You can provide feedback directly to Apple using the Feedback Assistant app.
Frequently Asked Questions
Have additional questions about
the Apple Beta Software Program?
Apple Developer Program
Mac Beta Games
Looking to build the next generation of amazing apps and test them on the developer beta?
