Amoss

Back to the drawing board, everything seems to be ok https://www.mail-tester.com/test-63ldd&reloaded=1 but emails to gmail are still not sent. I read here: https://tehnoblog.org/how-to-fix-bounced-email-from-your-server-by-google-gmail/ Can you please have a look at the logs of the emails (exim?) and see if you find anything suspicious? If someone knows how can I do it (using ssh?), please let me know. I didn't update exim or touched anything since our last interaction. Also, the guy from the Gmail forum directed me here where there are some warnings with my domain/dns: https://mxtoolbox.com/domain/stockdiv.com/ Thanks

Thanks for the explanation. Regarding the dmarc, I will wait for 2-3 days and see if it fixes the gmail problem. Thanks.

Thanks pete20r2 for your reply. I appreciate it very much. Based on mail-tester.com, my DKIM and SPF are correct and the only problem is not having a DMARC record. I know Krydos defined both spf and dkim. When I tried to activate the DNS in vestacp, I got a popup saying that DNS SYSTEM is not enabled. I have no idea if/how I can enable it and I don't know whether it was on purpose when the VPS was built. Because everything is working now (Except email to gmail), it looks like Krydos knew what he was doing and why, I ofcourse accept his configuration but probably there's just one last thing to do. In my domain registrar (godaddy) I set the following name servers: ns1.heliohost.org ns2.heliohost.org . There is an option to add records but it is disabled because my nameservers are not pointing to godaddy. The site say so. I can't point them to my domain because my domain is dns-less. Regarding your "Ask nicely for the required entries to be made on the Helio nameservers (SPF seems to already be done this way)" - I do so for over a week now :-) I don't know what cloudflare is and whether it has any advantage in my current situation.

Thank you Krydos. 1. I understand correctly that "sudo apt update" and "sudo apt upgrade" WON'T update my OS as well? I really don't want to break things up. 2. I still can't email to gmail, How can I do the following? Or maybe you already did it and I need to wait for 2-3 days? Please read here: https://support.goog...d/8130059?hl=en about the mail tester. The guy that replied said it's important. From mail-tester.com: You do not have a DMARC record A DMARC policy allows a sender to indicate that their emails are protected by SPF and/or DKIM, and give instruction if neither of those authentication methods passes. Please be sure you have a DKIM and SPF set before using DMARC.You do not have a DMARC record, please add a TXT record to your domain _dmarc.stockdiv.com with the following value: v=DMARC1; p=noneVerification details: mail-tester.com; dkim=pass (1024-bit key; unprotected) header.d=stockdiv.com header.i=@stockdiv.com header.b=XWeoplET; dkim-atps=neutralmail-tester.com; dmarc=none header.from=stockdiv.commail-tester.com; dkim=pass (1024-bit key; unprotected) header.d=stockdiv.com header.i=@stockdiv.com header.b=XWeoplET; dkim-atps=neutralFrom Domain: stockdiv.comDKIM Domain: stockdiv.com

I'm starting to wonder whether this problem will ever be addressed. Well, will it? Is it a complex one that requires something special? I'm really asking. I already posted here what needs to be done https://www.helionet.org/index/topic/35961-my-vps-is-high-on-load-again/page-2?do=findComment&comment=159445 It should be a one minute thing to do, no?

wolstech, Is your box running its own DNS server? I don't know. If I got the message dns system is not enabled, maybe it means it doesn't And thanks.

Hi wolstech and thank you for replying. If I had permissions to do what needs to be done, I would have done it myself. I tried entering the exim logging in order to see if there are any errors - no permissions on both users I have. I tried adding DMARC record myself but vestacp tells me dns system is not enabled to my domain, on the other hand, Krydos already defined other settings like SPF for example, he has more permissions than me so even if I want to do things on my own, I can't. A different example would be that after the last restart my emails went crazy (not just to gmail) and I realized that the vps name was renamed to its original name. I had the permissions to change it back and all was well (except gmail). What I'm saying is that if I have the permissions, I might nag much less.

I'm really trying to understand the behind the scenes of all this. For over a week I can't email to gmail, I posted here what can be done (I can't do it myself because I have no permissions to my own VPS) but only one person can do that and even when he is online, nothing is done and I'm left to wonder to myself what's going on. I know there is no intonation in text so I'm not angry or something, I'm asking humbly why is it taking so long to try my suggestion?

I agree with you but Krydos wrote 4.91 is the latest available and I sure don't want to compile the code of 4.92 and install it because it could break things. If 4.92 is available, I hope Krydos will install it. Currently my main issue is not being able to send emails to Gmail, not sure it is related to the exim version. Thank you for the grep insight, the thing is I don't have permissions to access those files so again, waiting for Krydos to do his thing. Though maybe adding the DMARC record will suffice as the person from Gmail forum has adviced.

1. So they are telling everybody to update to 4.92 but it's still not available? I agree with you that there is no reason to compile the source etc... 2. Here it is, 10/10 : https://www.mail-tester.com/test-07kmf&reloaded=1 I already changed back to my host. I just tried it again and failed. Do you see any errors from the mail server side? Please read here: https://support.google.com/mail/thread/8130059?hl=en about the mail tester. The guy that replied said it's important. You do not have a DMARC record A DMARC policy allows a sender to indicate that their emails are protected by SPF and/or DKIM, and give instruction if neither of those authentication methods passes. Please be sure you have a DKIM and SPF set before using DMARC.You do not have a DMARC record, please add a TXT record to your domain _dmarc.stockdiv.com with the following value: v=DMARC1; p=noneVerification details: mail-tester.com; dkim=pass (1024-bit key; unprotected) header.d=stockdiv.com header.i=@stockdiv.com header.b=XWeoplET; dkim-atps=neutralmail-tester.com; dmarc=none header.from=stockdiv.commail-tester.com; dkim=pass (1024-bit key; unprotected) header.d=stockdiv.com header.i=@stockdiv.com header.b=XWeoplET; dkim-atps=neutralFrom Domain: stockdiv.comDKIM Domain: stockdiv.com 3. Generally, do you see any errors on the apache and/or tomcat side?

The problem happens ONLY with gmail. ALL gmail addresses are failing for the above messages of retry reached. Do you see any errors on your side that can shed a light over this one? If I remember correctly, you added spamassassin not long time ago? Maybe this has got something to do with it? https://bobcares.com/blog/mail-error-450/ https://en.stealthsettings.com/fix-exim-error-hosts-domain-tld-failing-long-time-retry-time-reached.html Did you also did the following from the link #Delete files: rm /var/spool/exim4/db/* rm /var/spool/exim4/input/* rm /var/spool/exim4/msglog/* rm /var/log/exim4/*</pre> #Clear file: /var/log/dovecot.log</pre> My exim version is 4.91 while they recommend to update to 4.92 as soon as possible For some reason I don't have the view logs anymore - Did you remove this option somehow? I saw that you increased the memory to 2gb but as mentioned before: If the only problem is the updates-to-death the server itself is doing for no apparent reason, then the solution might be just disabling those auto updates. As far as I noticed, when those updates are not happening, everything is smooth. At least one good news is that I just redeployed my war and it went smooth. Not sure if it's just because the 2gb or also because no update-to-death process happened in between. I hope the emails problem will be solved soon as I'm unable to email to people that are using Gmail and needless to say, it's kinda in use by most people :-)

At first all failed with the following: --- This message was created automatically by mail delivery software. A message that you sent could not be delivered to one or more of its recipients. This is a permanent error. The following address(es) failed: ...@gmail.com all hosts for 'gmail.com' have been failing for a long time (and retry time not reached) --- This message was created automatically by mail delivery software. A message that you sent could not be delivered to one or more of its recipients. This is a permanent error. The following address(es) failed: ...@gmail.com host alt4.gmail-smtp-in.l.google.com [74.125.193.26] retry timeout exceeded --- then I noticed that server->hostname was back to vps13 so I changed it to my domain and sent the emails again for testing. I will give it few hours to see if the other sides actually received those emails. I looked in vestacp->web->domain->view logs->errorlog and there were a lot of them just from today. Any idea what is it? My exim version is 4.91 while they recommend to update to 4.92 as soon as possible

Just so things won't get lost in the way between pages: I might got the time wrong with the first occurrence but please look at the above screenshots (which were taken in the second occurrence), I described the time and loads every 10 minutes with explanation. all the above was after undeployment and deployment. You say that Vesta updated itself right in that time twice? Also, It is still in the same version/build so I'm not sure what is updated so often? What about the differences between the 2 cpus at the top and the cpus in the list? I didn't see any correlation when the high loads happened. I'm asking because I see high loads but I can't know what is causing it. What is my exim version? There seem to be an upgrade needed to 4.92. Do I have this version? If the load issues were due to my stuff, I'd go with doubling memory but if the problem is only when/because vesta update itself (are you sure the load issues in my screenshots are due to that?) I first want to rule this out. I've found the following in the documentation: v-delete-cron-vesta-autoupdate delete vesta autoupdate cron job options: NONE The function deletes vesta autoupdate cron job. v-list-sys-vesta-autoupdate list vesta autoupdate settings options: [FORMAT] The function for obtaining autoupdate setings. I know you have other things but I see you were online so why not doing at least the urgent stuff like the problem with the email? I'm locked out. My emails are not being sent anymore to anyone, can please someone follow the instructions form Krydos link? I tried to do it myself but I have no permissions to my own VPS (that could really save some efforts from you). I tried only restarting exim but it didn't help. #Delete files: rm /var/spool/exim4/db/* rm /var/spool/exim4/input/* rm /var/spool/exim4/msglog/* rm /var/log/exim4/*</pre> #Clear file: /var/log/dovecot.log</pre> #Then restart Exim4 OR Restart VPS service exim4 restart Do you know why the above happened? Do you know how to avoid it next time? 9:30am gmt+3 again my server is high due to update, this time it's mysql? even though you disabled it. Also what is python3 unattended upgrade? I don't understand why is it working so hard to update itself to death, specially things that are irrelevant. Can't this server just rest and do what it is told to do? https://i.ibb.co/J7xxYpt/1.png Generally speaking, I don't know what disadvantages you are talking about, your support and patience with me were more than one can ask for when you setup my VPS. We went through issues and problems and you fixed them in no time. Whenever you were online, I knew my need was fulfilled. When we got to the last line suddenly you were less there and even when you got online, urgent issues I had were not addressed. I got locked out without the ability to do something about it, just like now with the emails. Apparently I don't have permissions to do things on my own, that could relieve you some of the things. That surprised me. That's all. I feel like we need few minutes to make this VPS work already as it should and just then, things are postponed and prolonged, not sure why.

First of all, thanks for your reply. As you can see from my screenshots, the load issues were when I deployed the new war. And it happened twice in 2 different deployments and it stopped only after shutting down tomcat and restarting it. You say Vesta decided to update itself right at that time, twice? Also, It is still in the same version/build so I'm not sure what is updated so often? What about the differences between the 2 cpus at the top and the cpus in the list? I didn't see any correlation when the high loads happened. I'm asking because I see high loads but I can't know what is causing it. What is my exim version? If the load issues were due to my stuff, I'd go with doubling memory but if the problem is only when/because vesta update itself (are you sure the load issues in my screenshots are due to that?) I first want to rule this out. I searched google for disabling vesta update but found no results. I wonder if my VPS is the only one with this problem. The link you wrote also suggests to delete some files before reboot, I guess I don't really have another option so please reboot but please make sure that my war/site are working afterwards (remember what happened after the last reboot) and let me know after it's done. Thanks

Lately I started receiving this email when I'm sending an email from my server: This message was created automatically by mail delivery software. A message that you sent has not yet been delivered to one or more of its recipients after more than 24 hours on the queue on stockdiv.com. The message identifier is: 1haCN9-000TIg-Ea The date of the message is: Mon, 10 Jun 2019 07:57:13 +0300 The subject of the message is: Re: Feedback The address to which the message has not yet been delivered is: host alt4.gmail-smtp-in.l.google.com [74.125.193.26] No action is required on your part. Delivery attempts will continue for some time, and this warning may be repeated at intervals if the message remains undelivered. Eventually the mail delivery software will give up, and when that happens, the message will be returned to you. ---- The message technically say I should do nothing but because I get a lot of it lately and it means the recipients do not get my email in time and eventually it might not even send the email, please take a look at it. Not sure why it is not being delivered. Thanks

Soon I will need to re-deploy my war and the last thing I want is to go over the previous saga again. Please let me know if you need more info from me or if nothing is missing, what can be done to avoid it Thanks

The fact you got online after everything, doesn't say that everything was ok. Please read the following and let me know what can be done. Thanks This was taken in Jun 7th 11:20am (gmt+3). The load averages are again high (4-7). I don't understand the relation between the cpus at the top and in the list. The list shows htop taking most of it with 2% but the totals are 18 and 15.5. Also the LA is high but the high cpu percentage is just htop, I'm sure this is not causing the high LA. Also, what are all the lines I marked with arrows? How come vesta is doing so many updates and eventually it's still 0.9.8.24? If the memory is the problem but not because of my stuff then I want to first make sure we rule out everything else. If still we see a problem, then we might go with doubling the memory experiment. I don't want to think everything is ok and then when we decrease it, we'll have problems again. As you can see from the screenshot above and below, it looks like something is still eating my server and it's not my stuff. You said you increased the apache timeout to 60, can you increase it to 5 minutes and also server.xml? what was the timeout before that? After your changes (vesta/timeout) the LA is still high. It took me almost 20 minutes to write this message and all this time the LA was between 4 and 7 and is still is. Jun 7th or 8th 12:50pm (gmt+3) again a timeout was occurred. Do you see something on your side? Things have calmed down but please take a look at things so we can prevent the next occurrence of it. --- Here is the mess I was going through for more than an hour yesterday just because I needed to redeploy my war. Jun 9th 1am gmt+3 - I redeployed the war. undeploy took less than a minute, deploying took 7-8 minutes and the LA got to 13 at some point (as you warned me). Several minutes after deployment was successful and war started working again (getwarversion returned ok) - the LA remain high as 9 causing the other (heavier) requests to fail with 502, I guess due to apache timeout. Here is htop 5 minutes after deployment ended: not sure what is running so much of deployment ended. 10 minutes after deployment, war only works when asking for its version. Other heavier requests are still failing. and LA jumped back to 10 after 30 minutes from redeployment and WAR is not working at all (not even getwarversion), LA is around 10. Starting to think whether to restart tomcat or not, last time that was the only thing that saved the day. 40 minutes after redeployment, restarting tomcat , shutdown takes over 10 minutes, at this time nothing works. SSH takes forever to log in. This was taken 50 minutes after starting redeployment, more than 10 minutes after shutdown of tomcat which is still running: 50 minutes after, tomcat is still shutting down though La is a bit down to 2. Just when I wrote the above line, LA jumped to 10 After 60 minutes I stopped the tomcat shutdown process and started it again but apparently tomcat was off already but the ssh was stuck. I restarted tomcat. LA is 1-2. War is working. It looks like the tomcat shutdown/restart "fixed" it though I'm sure I'm not suppose to do that every war deployment. I hope that soon you will have time to look at all this and please tell me if this behavior makes sense and if not, based on the above processes and htop screenshots, what can be done about it.

After trying to redeploy my war, everything is a mess, nothing works and I'm lost. I'm just left with the hope that at some point Krydos will see this...

The problem is still happening so a new PM was sent with info and screenshots. Only then I see this reply. If it's ok with you, please read the PM, reply there and we'll continue here the next time. Thanks

My server is dead for a long time, VPS VPS but it gets spikes all over all the time and nothing can reach it, please someone contact Krydos? I guess he is not aware but my server is useless, no one can't work on it. I took a VPS because I was told its uptime is great and nothing will interfere it, until now, it seems the opposite, he is dead often because of high loads.

So again my VPS gets high loading averages, don't know what is it this time. I pm Krydos with information and screenshots, please let him know as soon as possible as it happens much too often. Thanks

@Krydos - I sent you a PM, there is/was another problem

Edited

Done and new logs are shown. Thanks.

It didn't happen even before I redeployed it. now my question is why the logs are not created /opt/tomcat/apache-tomcat-9.0.19/logs