What about Collosians 2:16-17?

Let no man therefore judge you in meat, or in drink, or in respect of an holyday, or of the new moon, or of the sabbath days: Which are a shadow of things to come; but the body is of Christ.  Col 2:16-17

Is the context here that since you are not observing the Torah with respect to what you eat or any holy day or new moon or sabbath, no one should judge you?  If you are not observing these commandments, is it no big deal because they are just "shadows"?  

Or, could it be something different?  What if the context is that you are observing Torah, you do eat and drink clean, that you observe holydays, and new moons and sabbath days?  Should you ignore those that judge you for being observant? 

Who is this "man that judges you"?  Who is Paul referring to?  Well, actually, he tells us in the following:

Col 2:8 Beware lest any man spoil you through philosophy and vain deceit, after the tradition of men, after the rudiments of the world, and not after Christ.

So the man judging you is "not after Christ".  This is a letter to Colosse where there were teachers that were adding things to the Torah.  It would be like adding things to it.  Kind of like the Pharisees - they did this all the time.  For example, the Torah would say "honor the Sabbath" and rest.  Very simple, "rest".  But the Pharisees would add all kinds of definitions.  

They challenged Yeshua about working on the Sabbath when his disciples were walking through the fields and eating the wheat.

Mar 7:3 For the Pharisees, and all the Jews, except they wash their hands oft, eat not, holding the tradition of the elders. 

Yeshua addressed their false teachings:

Mar 7:7 Howbeit in vain do they worship me, teaching for doctrines the commandments of men.

It's similar here in Collosians.  Men have added "commandments of men" to the observance of the Torah.  Just like when Yeshua said that when the Pharisees are reading the Torah while sitting in Moses' seat, to observe what they read.  But don't do their works.  They add all kinds of things.

Mat 23.2  Saying, The scribes and the Pharisees sit in Moses' seat:

Mat 23.3 All therefore whatsoever they bid you observe, that observe and do; but do not ye after their works: for they say, and do not.

Now some folks also think that the Torah is abolished because Paul says they are "shadow of things to come".  Notice that its of things to come, not of things that have already come.  It is true that there are still things to come that the feasts and holydays and new moons, and sabbath days foretell.  

Has Christ returned to establish his millenium reign?  That's still to come.

Also please remember that Christ tells us when the Law and the Prophets are to be abolished.  It's when "heaven and earth have passed away".  That hasn't happened either.  That also is a thing to come.  These things Paul is talking about are still shadows of things to come.

Think not that I am come to destroy the law, or the prophets: I am not come to destroy, but to fulfil. For verily I say unto you, Till heaven and earth pass, one jot or one tittle shall in no wise pass from the law, till all be fulfilled. Mat 5.17-18

For a very good discussion, see the following video from 119 Ministries: 

https://www.youtube.com/watch?v=Mgq5O-wDIEs&t=2s

An excellent article concerning this discussion can be found here: https://hallel.info/torah-colossians-2/https://hallel.info/torah-colossians-2/