I agree with you. FILLED with the Spirit disallows one to have anything else inside, though. Paul said to not give PLACE (TOPOS in Greek, which means OCCUPANCY) to the devil.
Acts 2:38 is not a cure-all. We must STAY filled with the Spirit.
God dwelt in the most holy place of the temple. That is synonymous with indwelling our human spirits. But we have soul and body as well. And if our souls are not yielded to God for His spirit to influence us, the Spirit of God is locked away in our human spirits alone, and there will be darkness in our souls from sin and carnality.
See my thoughts here:
http://mikeblume.com/total.htm