Do you think dog owners have the right to get angry at me for this?

today I got in an elevator and there were two seniors and a golden retriever. The dog was coming toward me and I backed away to avoid it because I was wearing my pj and I have a sentiment that big dogs are usually not clean(big means harder to clean). This lady said that golden retriever is a nice dog. and asked me if I didn't like dogs. I said no but I was acting like this because I was wearing my pj. I know I shouldn't have said it and shouldn't have wore pj in an elevator. I only wanted to check mail in my condo.