We present high angular resolution imaging of the quasar PSO J172.3556+18.7734 at \(z=6.82\) with the Very Long Baseline Array (VLBA). This source currently holds the record of being the highest redshift radio-loud quasar. These observations reveal a dominant radio source with a flux density of \(398.4 \pm 61.4~\mu\)Jy at 1.53 GHz, a deconvolved size of \(9.9 \times 3.5\) mas (\(52.5 \times 18.6\) pc), and an intrinsic brightness temperature of (\(4.7 \pm 0.7) \times 10^7\) K. A weak unresolved radio extension from the main source is also detected at \(\sim~3.1\sigma\) level. The total flux density recovered with the VLBA at 1.53 GHz is consistent with that measured with the Very Large Array (VLA) at a similar frequency. The quasar is not detected at 4.67 GHz with the VLBA, suggesting a steep spectral index with a limit of \(\alpha^{1.53}_{4.67} < -\)1.55. The quasar is also not detected with the VLBA at 7.67 GHz. The overall characteristics of the quasar suggest that it is a very young radio source similar to lower redshift Gigahertz Peaked Spectrum radio sources, with an estimated kinematic age of \(\sim~10^3\) years. The VLA observations of this quasar revealed a second radio source in the field \(23\rlap{.}{''}1\) away. This radio source, which does not have an optical or IR counterpart, is not detected with the VLBA at any of the observed frequencies. Its non-detection at the lowest observed VLBA frequency suggests that it is resolved out, implying a size larger than ~\(0\rlap{.}{''}17\). It is thus likely situated at lower redshift than the quasar.