Locations where specialty crops can be grown in Ontario may need to shift due to changes in climate or due to urban expansion. However, the suitability of existing agricultural lands for the expansion of specialty crop types remains uncertain. This research explored relationships between topographic features and soils to understand the presence/absence of specialty crops found within southern Ontario. Utilizing Agriculture and Agri-Food Canada’s (AAFC) crop inventory (ACI) between 2014 and 2021, the presence and absence of several specialty crop types was identified, and models developed to explain these patterns using random forests (RF). The RF models considered 34 soil and topographic features and achieved high accuracy with the mean Matthews Correlation Coefficient (MCC) and Area Under the Curve of Precision-Recall (AUC-PR) coefficients of 0.87 and 0.92 respectively for making predictions of current specialty crop growing locations. Topographic features such as elevation relative to watershed minimum and maximum, direct radiation on Day 172, and spherical standard deviation of normal emerged as important variables for explaining the presence and absence of several specialty crop types. The results of this study also identifies many new spatial locations where the expansion specialty crops may be possible, particularly if the climates in these areas become more favorable. The importance of topographic features when identifying suitable areas for specialty crops is also highlighted.