What kind of test did you use? The rapid tests are not always very accurate. A negative result might not mean that you do not have it. And yes, the time of taking the test / day of infection does make a difference. The loss of smell and taste does sound like it might have been covid.