the absence of the mesh network. We refer to these
as offline datasets. These datasets are summarized
in Table 1, with sample rates explained later in Sec-
tion 3.2.3. set1 spaces include 8, 20, 25, 27, 34, 36,
44, 53, 58, 64, 75, and 83. set2 spaces includes 25,
27, 29, 34, 36, 38, 39, 56, 58, 60, 62, 64, 67, 70, 71,
75-77, 79-81, and 87-89. set3 includes 1-2, 4, 6, 10-
13, 18, 20, 24, 31-33, 35, 37, 39-45, 49-50, 53-55,
64, 66, 68, 72, 75, 77-78, 80, 82, and 90. set4 spaces
includes 25, 27, 29, 34, 36, 56, 58, 60, 71, 72, and
75-76.
Table 1: Dataset Space Composition (of 90 total spaces).
Name Source Spaces Collect Rate
Tripod Tripod all but 84-88 Offline Constant
350 o 350Z set2 Offline Constant
370 o 370Z all (1-90) Offline Constant
TL o Acura set3 Offline Constant
350 m1 350Z set4 Mesh Constant
350 m2 350Z set1 Mesh Constant
350 m3 350Z set1 Mesh 60s sample
370 m 370Z set1 Mesh 60s sample
Rogue m Rogue set1 Mesh 60s sample
Prior experiments used the entire target parking
lot (Seymer et al., 2019). Our current experiments
removed Zone 3 (see Figure 3) due to un-relocatable
physical obstacles in those spaces. We also sought the
opportunity to deploy additional beacons compared to
past work, allowing us to study the effect of additional
RSSI datapoints on prediction accuracy, described in
the next section.
3.1 Improved Prediction Model
In prior work we found that a Random Forest algo-
rithm produced the most accurate predictions com-
pared to similar classifiers, and we continue to use
that algorithm in this work. However we made sev-
eral improvements to our model based on what we
learned in our experiments. We outline each of these
improvements, along with our reasoning, in this sub-
section.
3.1.1 Initial Improvements to Model and
Feature-set
We reduced our feature-set after experiments deter-
mined that only the maximum RSSI value within a
time window consistently produced accurate results.
This resulted in our feature vector shrinking from 38
in prior work, to 10 total features per time interval.
After taking RSSI measurements for each space in the
lot, we constructed a random forest model based on
these 10 features, and summarize results in Table 2.
Here we see three models trained with the tripod (tri)
dataset, and used with TL o, 350 o, and 370 o in-
vehicle datasets. Columns TP and R show True Posi-
tive percentage and ROC area, respectively. The first
model is a Random Forest model with default settings
(no random tie breakers, iteration total of 100), with
optimized models that are configured to randomly se-
lected ties found by the algorithm, with total itera-
tions set to 1000 and 1500 (respectively). All models
use 10-fold cross-validation (CV). We use this same
model evaluation and tuning strategy throughout this
work, so that we can study the effect of model tuning
on prediction accuracy. The results of this experiment
show that while the model evaluates to 100% accu-
racy (in the second optimized case), it is only suc-
cessful at predicting other vehicles’ space occupancy
by between approximately 8% and 14%, decreasing
with our model optimization strategy. This is similar
to the results from our prior experiments, and clearly
requires improvement to make this a viable solution,
even after introducing additional sensor nodes as we
have done in this work.
Table 2: Initial Per-Space Tripod (tri) Model Results.
Model
Default Optimized 1 Optimized 2
(Dataset) TP R TP R TP R
tri 99.88% 1 99.96% 1 100.0% 1
tri(TL o) 11.23% 0.80 10.96% 0.87 10.44% 0.87
tri(350 o) 8.94% 0.79 8.94% 0.80 8.18% 0.83
tri(370 o) 14.05% 0.74 10.99% 0.81 10.91% 0.82
3.1.2 Zone based Occupancy Detection
After closely analyzing the specific error cases in our
last experiment, we surmised that we could improve
our solution accuracy if we migrated from a per-space
to a zoned based space occupancy strategy. In this
case, the parking provider cares more about the area
of the lot a vehicle is in than the individual space. In
theory, this should improve our results in cases where
the predicted space is near the true space. Using the
same data, we divided up the lot into zones as de-
fined in Section 2.1.1, and re-labeled our dataset ac-
cordingly and trained a new zone-based model. Our
results are shown in Table 3. While this significantly
improved the results, for some vehicles there was little
improvement, and overall still below acceptable accu-
racy.
3.1.3 In-vehicle Effects on Beacon Attenuation
After re-examining our testing results, we noticed that
there was an inconsistent decrease in RSSI values
when comparing the tripod’s signature with the in-
vehicle signature. When the beacon is located on a
Smart Parking Zones using Dual Mode Routed Bluetooth Fogged Meshes
217