Many Otoplasty patients experience what you are. The degree of swelling varies, as does scar tissue, based upon the technique employed, sutures used, your skin type, and overall health.
It can be difficult to stay patient. It can take several years for all of the subtle changes to equalize.
Stay in touch with your surgeon and follow all post-op instructions. Communicate your fears.
Of course, it is hard to say without examining you. There is complex interaction between the skin, cartilage and scar in an already complex three-dimensional area with minimal to no support on the very edge. All this can cause less than desireable/predictable changes sometimes. I don't know the time from your surgery, but if it has been 6-12 months, this is not likely to improve any more. I have successfully used filler to improve a poorly supported area of the rim.