I got a "nearly" 3 year old and 9 months old at home and let me tell you relationships take a big step back sexually with young children around. You are both tired from being a parent plus stresses of everyday life. Stress will always be around but I'm finally starting to get more time with the wife again and things are coming back to where they were before kids.
Its no walk in the park but just keep at it be open and TALK to eachother. I cant say it will work out but you owe it to yourselves and your lovely little one to try harder.
If thoughts get a little OJ simpson like perhaps you should boogie before you get to that point.