forum.coppermine-gallery.net

Support => cpg1.5.x Support => cpg1.5 upload => Topic started by: Yasmin86 on March 08, 2015, 01:10:28 pm

Title: Creates duplicates with batch-add
Post by: Yasmin86 on March 08, 2015, 01:10:28 pm
I've been adding -a lot- of files to my new gallery over the weekend, and last night and this morning I suddenly ran into a new problem with my last couple of albums: When I batch-add files, it creates duplicates. They aren't duplicates via my FTP, and the album they go into is empty.

Example album with duplicates: http://www.ryanpaeveynet.com/gallery/thumbnails.php?album=84 Originally I uploaded about 95 files or so via FTP, but as you can see, the album now contains 165. I even unchecked the ones that had the DP icon before adding them to the album during batch-add, but they still seem to have made it. (I also get the radar icon on some)

I made a test account:
name: tester
password: tester

Deleting one of the duplicates (say one of the two "099.jpg") doesn't help, it deletes them both.  I set the "default upload method" to "simple" and tried uploading 099.jpg (renamed it 099-test.jpg) again and it worked no problem.

I created a test album as the troubleshooter asks, and even that duplicated. Uploaded a small image with the test user and it worked fine.

Thanks in advance for any help, hope I did everything right!
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on March 13, 2015, 02:46:00 pm
Am I not getting any help because I did something wrong in my post or because nobody can actually help me? My problem still persists, unfortunately  :-\
Title: Re: Creates duplicates with batch-add
Post by: Αndré on March 30, 2015, 10:16:28 am
Have you added a keyword to that album? If so, that's probably intended behavior of the album keyword feature (have a look at the docs for more information).
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 02, 2015, 02:27:16 pm
I haven't added any myself, but it says 'admin' there as default (can't remove it, it just pops back up)

(http://i58.tinypic.com/15prcdh.jpg)

When I click Keyword Manager it shows nothing.

(http://i61.tinypic.com/30nj7sy.jpg)
Title: Re: Creates duplicates with batch-add
Post by: Αndré on April 06, 2015, 09:13:55 pm
Please have a look at that thread: http://forum.coppermine-gallery.net/index.php/topic,77686.msg375519.html#msg375519

A user already had the same issue. It turned out to be a browser cache issue. Please delete the album keyword from the affected album(s), clear your browser cache and check again if the album keyword has been removed and if the "duplicates" don't exist anymore.
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 15, 2015, 04:30:06 pm
Thanks! I swear I searched before I posted, but that post didn't come up. I see they didn't use the same words as I did though.

Anyway, I cleared my cache and uploaded three albums, and all is good so far! Seems to have solved the problem, thanks a lot - eternally grateful!
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 15, 2015, 11:01:59 pm
Ok. I've uploaded lots of albums all day and it's been fine, but now it's back again. And there are no keywords this time. I even cleared my cache again and tried right after, but it still happened :(
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 15, 2015, 11:16:00 pm
Do you use album keyords in Album properties?
If an album has a keywords (let's say dress) then all the images that have the keyword dress will show up in that album and in the original album (the album that contains the image).
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 15, 2015, 11:19:21 pm
Read more here: http://documentation.coppermine-gallery.net/en/albums.htm#album_prop_controls_album_keyword (http://documentation.coppermine-gallery.net/en/albums.htm#album_prop_controls_album_keyword)
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 15, 2015, 11:25:06 pm
Nope. And I just looked back at the other albums, and now one of them has duplicates, which did not happen when I batch added them, as with the others. Very, very strange.
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 15, 2015, 11:36:22 pm
This link gives me an error. Can you post an album link with duplicates:  http://www.ryanpaeveynet.com/gallery/thumbnails.php?album=84 (http://www.ryanpaeveynet.com/gallery/thumbnails.php?album=84)

Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 15, 2015, 11:38:36 pm
I deleted the two that gave me duplicates while batch adding (I can do it again if it helps you?). But this is the one where duplicates occured -after- I already, successfully, uploaded everything: http://ryanpaeveynet.com/gallery/thumbnails.php?album=106

(Btw, appreciate all the help!)
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 16, 2015, 12:13:37 am
The files have the same name and they are in the same folder. Is not possible for two files with the same name to be in the same folder. Is clear that you don't have duplicates on your server.

I made a test on my gallery and I can not upload and image already uploaded with batch add in another album but I can uplod it in the same album. Maybe you
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 16, 2015, 12:23:59 am
Maybe you shoud upgrade. Is very easy and could solve your problem: http://documentation.coppermine-gallery.net/en/upgrading.htm (http://documentation.coppermine-gallery.net/en/upgrading.htm)
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 16, 2015, 12:53:07 am
Maybe I what? Yes their names are the same because they're duplicates? They weren't when I uploaded them.

I'm trying again, and when I made a new album just now, it also duplicated. Right there in the Album Manager (as I was changing the order of the albums it duplicated.)

I uploaded pictures to this new, empty album, and got the duplicate icon on a lot of them again when batch adding (see attachment). This is the album: http://ryanpaeveynet.com/gallery/thumbnails.php?album=116

As for update: I have 1.5.34. Isn't that the most recent version?
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 16, 2015, 12:57:04 am
Both images have the same name (i002.jpg), show in the same folder (albums/television/general hospital/2015/january/january 5) but they show twice in the same album (January 5, 2015) . Plus they have diffrent image pid: 5325 and 5325.

Maybe you shoud upgrade.
The tester acount is no use. In coppermine only the admin of the gallery can upload via batch add.
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 16, 2015, 01:03:16 am
As for update: I have 1.5.34. Isn't that the most recent version?

Yes, but the upgrade will overwrite all coppermine core files and can fix your issue.
I use batch add and I never seen a think like that.
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 16, 2015, 01:09:01 am
Yeah, it's weird, because I have two other Coppermine galleries (one I've had for 4 years) and I've never experienced this problem before on either of those. Thanks for your help.
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 16, 2015, 01:10:17 am
(By the way, I originally posted it here in uploads but I think André moved it to misc. Just FYI).
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 16, 2015, 01:43:38 am
Did you edited core coppermine files?
I'm a trusted coppermine member. Can I login as an admin so I can batch add files. You can change your password after I finish.
First you have to create an album in the albums directory like January 6 and upload some pics.
Title: Re: Creates duplicates with batch-add
Post by: Αndré on April 16, 2015, 10:52:07 am
It seems that, for some reason, the affected files got added twice (same file path and name, but different picture ID). So what we now see is not related to the albums keyword feature.

Please create a new test album. Additionally, please create a new test folder on your server, upload some files and batch-add them to the new test album. Do you still/always get duplicates? If so, please again create a test album, new test folder and test files and try if it happens when you use the Coppermine default theme "curve": http://ryanpaeveynet.com/gallery/?theme=curve

Have you installed any plugins or applied modifications? If so, please (temporary) disable/remove them and try again.
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 16, 2015, 01:19:34 pm
André:

I just tried again. Successfully uploaded about 3 or 4 albums before it happened again (this album: http://ryanpaeveynet.com/gallery/thumbnails.php?album=126)

Tried with the curve theme with a new album and new pictures, still got duplicates (see attachment). This album: http://ryanpaeveynet.com/gallery/thumbnails.php?album=122

I don't have any plugins. Haven't modified any core coppermine files as far as I know. Just installed as usual and added the custom theme.
Title: Re: Creates duplicates with batch-add
Post by: Αndré on April 16, 2015, 08:54:48 pm
Please provide a zip package which contains files where it happens always, so we can test and maybe reproduce it ourselves.
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 17, 2015, 12:32:45 am
I'm terribly sorry, but I don't understand what you mean with "files where it happens always"? The files I uploaded that became duplicates?
Title: Re: Creates duplicates with batch-add
Post by: Αndré on April 17, 2015, 09:22:47 am
Yes. I doubt that your files are the cause, but we need to be sure.
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 23, 2015, 12:14:18 pm
Ok, here you go, the ones I added in here got duplicated :)
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 23, 2015, 01:51:36 pm
for Andre

Sometimes the hosting provider moves your website to another server or the server had a crash etc and the coppermine files got corrupted.
I think replacing (overwrite) the coppermine files with new ones may help. She only has to download coppermine and upload all files but not the albums, docs, images and themes directory and anycontent.php, then run update.php.
Is not so hard.
How to overwrite: http://documentation.coppermine-gallery.net/en/upgrading.htm#upgrade_any (http://documentation.coppermine-gallery.net/en/upgrading.htm#upgrade_any)

What do you think? Could be a corrupted files problem?


I forgot IMPORTANT: the include folder has config.inc.php.
If you delete that then you will cry. Do not delete the entire include folder.

Title: Re: Creates duplicates with batch-add
Post by: allvip on April 23, 2015, 01:59:34 pm
for Andre

Both images have the same name (i002.jpg), show in the same folder (albums/television/general hospital/2015/january/january 5) but they show twice in the same album (January 5, 2015) . Plus they have diffrent image pid id.

Could be a corrupted database?
Maybe her host provider has a backup of the database before the day the duplicates start happening.
On my host I had the possibility to restore the database from a older backup they saved for me.
Title: Re: Creates duplicates with batch-add
Post by: Αndré on April 27, 2015, 11:08:57 am
I just batch-added your provides files to my server and they were added just once (no duplicates). Please do as allvip suggests and overwrite all Coppermine updates like you'd do during an update.

If it still doesn't work, you can check the following:
1. Download your whole gallery and database to your local computer and check if the issue also occurs there.
2. Install a second test gallery on your server and and check if the issue also occurs there.
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 27, 2015, 12:05:04 pm
Ok, I'll update it! Should I be uploading the "albums" part from the latest version too, or will that erase all the pics I've uploaded so far? (I'm using Transmit FTP)
Title: Re: Creates duplicates with batch-add
Post by: Αndré on April 27, 2015, 12:08:29 pm
Please have a look at the upgrade documentation.
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 27, 2015, 12:11:37 pm
Yes, it says:

"In fact, you could upload the albums folder as well - the one that is contained in the package is empty anyway. The recommendation not to upload this folder is only meant as a pre-caution for some users who have "funny" settings for their FTP apps: some exotic FTP applications delete folders existing on the server and then re-create an empty folder on the server-side. This would of course be a disaster for all existing galleries during the upgrade process, as you would lose all your uploaded files in your gallery. However, the number of FTP apps that is set up in that strange way is small and therefore, it won't hurt for most to upload the albums folder as well. If you're not sure, use one of the FTP clients recommended by the devs."

And Transmit isn't on the list. I don't think Transmit is very "exotic", but I'll just don't for now then.
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 27, 2015, 01:16:27 pm
I got this error message. Does this have anything to do with anything? Should I just open my local include folder and upload the things inside instead of the folder itself?
Title: Re: Creates duplicates with batch-add
Post by: Αndré on April 27, 2015, 01:31:22 pm
Please use one of our recommended FTP apps, e.g. FileZilla, as there's no need to remove any directory for an upgrade.
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 27, 2015, 03:08:44 pm
I've tried installing FileZilla 4 times now, restarted my laptop and everything, but it freezes here every time. Man, I'm just having bad luck all around....
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 27, 2015, 07:43:00 pm
I got this error message. Does this have anything to do with anything? Should I just open my local include folder and upload the things inside instead of the folder itself?

You should contact your webhost for this.
I belive your hosting provider is http://www.hostdime.com/ (http://www.hostdime.com/).
They have 24h live chat support.
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 27, 2015, 07:54:54 pm
I've tried installing FileZilla 4 times now, restarted my laptop and everything, but it freezes here every time. Man, I'm just having bad luck all around....

If FileZilla won't work then make a folder named new in your gallery folder and upload cpg1.5.34.zip, then extract the zip archive (I don't know if your webhost has that option).

Move all files from the folder new to gallery folder (to overite the files) but not the albums, docs, images and themes directory and anycontent.php, then type in your browser http://ryanpaeveynet.com/gallery/update.php (http://ryanpaeveynet.com/gallery/update.php).

Don't move all at once. First the bridge folder, then the css etc. Step by step so you will make it without problems. At the end you can delete the new folder.
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 27, 2015, 08:24:02 pm
My webhost is Surpass.

I just got an email from them:
Quote
Hello,

We received an unauthorized support request from the following contact that was attempting to receive support with deleting the include directory from your gallery directory for a coppermine gallery.
http://ryanpaeveynet.com/gallery/

Reason for editing: is my private email.

Question: I can not delete a directory (folder).

I would suggest that if this individual is going to continue to put in support requests, that you add the user(s) to your Authorized contact list so that they may receive support in the future.

Now I'm stressing out a little. Who is?
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 27, 2015, 08:25:49 pm
My webhost is Surpass.

I just got an email from them:
Now I'm stressing out a little. Who is?

I am and I told them that I am from coppermine and ask them to help you.
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 27, 2015, 08:29:11 pm
Oh, ok, good. Lol. I can add you to the authorized contacts list so you can receive support.
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 27, 2015, 08:33:05 pm
Oh, ok, good. Lol. I can add you to the authorized contacts list so you can receive support.

No, no. This one was just one time thing.
You can always contact them. They respond very fast.

BTW: You said that is not http://www.hostdime.com/. Is Surpass. That means I contact it the wrong host?
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 27, 2015, 08:41:12 pm
Even Surpass has Live Chat. Contact them and they will help you with your error and even how to use FileZilla after you install it or how to overwrite files in your file manager and anyting you need.
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 27, 2015, 08:53:28 pm
Yeah, I have Surpass for all my domains, never had anything else. But you did something right since they contacted me about you contacting them though? I just wrote them back on the ticket explaining the initial error with the directory and everything.
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 27, 2015, 09:17:10 pm
I've tried installing FileZilla 4 times now, restarted my laptop and everything, but it freezes here every time. Man, I'm just having bad luck all around....

Did you downloaded the right FileZilla?
If you have MAC OS not Windows then on this page https://filezilla-project.org/download.php?show_all=1 (https://filezilla-project.org/download.php?show_all=1) download the MAC version.



Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 27, 2015, 09:18:51 pm
I got this reply:

Quote
Looking into the gallery/ directory on your account I can see that the include/ subdirectory has incorrect 777 permissions. These permissions can cause the directory to become inaccessible or non-editable. It is possible that the update process you are attempting is failing when attempting to modify this directory due to its permissions.

I have repaired the permissions on your account, and recommend that you attempt the update process again. If you have any further issues, or further questions, please feel free to contact us again.

When I set up the gallery I contacted Surpass to have them set the right permissions for me as directed by the Coppermine installation guide..

Yes, I downloaded the right FileZilla. I tried the regular one and from the "more download options".
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 27, 2015, 09:27:03 pm
CuteFTP http://www.cuteftp.com/trial.aspx (http://www.cuteftp.com/trial.aspx) is very good.
I used myself. The trail is fully functional for 30 days.

Title: Re: Creates duplicates with batch-add
Post by: allvip on April 27, 2015, 09:52:02 pm
When I set up the gallery I contacted Surpass to have them set the right permissions for me as directed by the Coppermine installation guide..

I never ask my host to set permissions and I had 3 diffrent hosts.
When you install coppermine if at step 3 everything is like in my screenshoot, then coppermine will work fine.

See all steps here: http://forum.coppermine-gallery.net/index.php/topic,77959.0.html (http://forum.coppermine-gallery.net/index.php/topic,77959.0.html)
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 27, 2015, 10:00:43 pm
I forgot IMPORTANT: the include folder has config.inc.php.
If you delete that then you will cry. Do not delete the entire include folder.
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 27, 2015, 10:22:33 pm
yeah....  I already did. I downloaded it to my desktop before I started though. Or will that not help?

You know what, I'm thisclose to just giving up and deleting the gallery all together. This is a little demotivating :( You think deleting it and re-installing will make it better the second time around? I still have every file in the gallery located either on my laptop or on another server (in another gallery) so I won't lose anything, and it'd be a bit of a bitch to re-upload everything but not the end of the world.

(Can't tell you enough how I appreciate your help though, you and André are both sweethearts for having patience with me!)
Title: Re: Creates duplicates with batch-add
Post by: allvip on April 27, 2015, 10:33:53 pm
yeah....  I already did. I downloaded it to my desktop before I started though. Or will that not help?

GREAT. That will work.

You know what, I'm thisclose to just giving up and deleting the gallery all together.

No. Just do like I said at Reply #26. Maybe the include folder had the right permissions. Was not deletable because config.inc.php.

Set permissions on the "albums" and "include" folders in your Coppermine directory (permissions to 755 or 777, depending on your server config) http://documentation.coppermine-gallery.net/en/install.htm#how_permissions (http://documentation.coppermine-gallery.net/en/install.htm#how_permissions)
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on April 29, 2015, 10:24:57 pm
Ok, so I've been uploading for about two days now, and so far so good! That little green check mark is a thing of beauty.

It let me upload without problems for a bit last time too before it suddenly started again so I won't count my chickens yet, but it's looking good! :) Can't thank you enough, guys!
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on May 05, 2015, 06:01:09 pm
Everything was fine up until just now... I think I'm gonna cry. lol. I'm so over this problem.
Title: Re: Re: Creates duplicates with batch-add
Post by: Αndré on May 05, 2015, 08:52:56 pm
I suggest to
1. Download your whole gallery and database to your local computer and check if the issue also occurs there.
2. Install a second test gallery on your server and and check if the issue also occurs there.
Title: Re: Creates duplicates with batch-add
Post by: Yasmin86 on June 26, 2015, 12:48:18 am
Sorry for the long vacation, but I'm back and ready to figure this out again I guess..

André:
1. With option 1, do I have to download the entire albums folder as well? It's over 4GB by now.. Or can I use an empty one from the newest version I just downloaded?
2. Option 2, do I have to use new databases or the same as in the first gallery?
Title: Re: Creates duplicates with batch-add
Post by: Αndré on June 26, 2015, 02:36:26 pm
1. Please download the whole albums directory. Usually you could also use an empty directory, but usually batch-add also don't create duplicates ;) As a side effect you'll also have a local backup, which is always a good idea.

2. Please test both.
Title: Re: Creates duplicates with batch-add
Post by: Αndré on September 22, 2015, 11:26:37 am
As the problem occurs randomly, I wasn't able to reproduce it in Yasmin's gallery. Instead, I wrote 2 scripts to check for dupes and remove them from the database. Anyone with the same issue, please download the attached zip file, upload its content to your gallery root directory and visit check_dupes.php with your browser, while logged in as gallery admin.