Seems like GE on a 2x2 matrix should be pretty darn fast.... especially if you use scalar * vector type operations.
This article presents a from-scratch C# implementation of the second technique: using SVD to compute eigenvalues and eigenvectors from the standardized source data. If you're not familiar with PCA, ...