Absolutely, you want to alienate as few readers as possible. The danger though, is that a lot of Sci-Fi has this tendency to go into unnecessary detail about how technology works, with character discussing or thinking about advances in a way that real people just never do.
There was a short story written, and I can't for the life of me find it, where the writer describes two people in a modern setting going on a plane journey. It's funny to read, because ordinary people don't think about the aerodynamic properties of air travel, or how amazing it is that a network of satellites in orbit around the planet allows for instant communication through handheld devices, even when traveling through the sky.
So if you write a book, say a noir detective story set on a human colony, it's going to be difficult to slip in a scene where your detective thinks about how the colony was founded by a liveship that travelled for thirty years on a one-way trip from Earth, or that it's fortunate that scientists managed to figure out a way to stabilize wormholes for interstellar travel. You run the risk of taking the reader out of the story, breaking the flow in a very recognizable way to explain the setting to the reader. If the detective is investigating the death of someone related to the man who developed the technology allowing the colony to be founded, then you have a perfect way to introduce that information, but not every story needs that.