Identity Broker Forum

Welcome to the community forum for Identity Broker.

Browse the knowledge base, ask questions directly to the product group, or leverage the community to get answers. Leave ideas for new features and vote for the features or bug fixes you want most.

+8
Completed

Add SFTP functionality to the CSV connector and/or agent

Aneesh Varghese 8 years ago in CSV connector updated by Matthew Davis (Technical Product Manager) 1 year ago 2

Add the ability for the FTP agent to connect to SFTP servers. Also update the CSV connector if required to be able to use the updates to the connector.

Answer

Available in latest 5.3 release, and will be available in 6.0 as well.

SSH Agent / UNIFYBroker knowledge / UNIFY Solutions 

+5
Completed

Please support write/export operation for CSV Connector using FTP agent.

Aneesh Varghese 8 years ago in CSV connector updated by anonymous 6 years ago 6

CSV Connector using FTP agent currently doesn't support write/export operation but only import. Understood, it is a bit more complicated than updating a local file but can we look to see what we can do or suggest a workaround to cater write operation.


Some HR Systems like "PayGlobal" currently doesn't have a Web Service interface and the only option for integration is CSV/file extracts. Systems like PayGlobal is also remotely hosted on the Vendors Cloud environment and does require remote file transfer.


Thanks,

Aneesh

0
Planned

CSV connector fails all add entities during data load if the file doesn't exist

Adrian Corston 2 years ago in CSV connector updated by Matthew Davis (Technical Product Manager) 1 year ago 1

I'm doing data load in a new environment and an export CSV didn't exist before I ran Add Entities to populate it.  Since the file didn't exist the connector is failing the entity adds and the log file is now filling with one error for each entity, which has made the system unusable for over 5 minutes.  If I had more like 100,000 records to write out this could delay the data load activity for an hour or more.

While not a show-stopper (I've now created a CSV file with headers and no data and re-run the Add Entities operation) it's annoying and I don't see why the file can't simply be created if it doesn't exist.

0
Answered

CSV connector date field parsing expects US format (mm/dd/yyyy)

Adrian Corston 3 years ago in CSV connector updated by Beau Harrison (Senior Product Software Engineer) 3 years ago 3

I have a CSV connector with a date field, and it is expecting US date format (mm/dd/yyyy).  Can this be set to expect Australia format (dd/mm/yyyy) instead, or should I parse it by hand using a PowerShell transform in my adapter?

0
Answered

CSV connector with multivalued attributes

Adrian Corston 3 years ago in CSV connector updated by Matthew Davis (Technical Product Manager) 3 years ago 4

Is it possible to have multivalued attributes in a CSV connector?

Answer

Hey Adrian,

The CSV connector does support multi value attributes. If you wrap the mutli value column in quotes, and comma separate each value inside that column, the connector will import into a multi value field - as long as you set the connector schema to the appropriate multi value that you're after. 

For example, a CSV like so:

id,name,data
1,user1,"value1,value2,value3,value4"
2,user2,"value1,value2,value3,value4"
3,user3,"value1,value2,value3,value4"
4,user4,"value1,value2,value3,value4"
5,user5,"value1,value2,value3,value4"

will return "value1, value2, value3, value4" as 4 different values inside the multi value string schema field "data".

0
Fixed

Can't edit the FTP Agent timeout

Adrian Corston 4 years ago in CSV connector updated by Matthew Davis (Technical Product Manager) 3 years ago 3

When editing the FTP Agent timeout, the value entered is not saved and always resets back to 00:00:00.

v5.3.2 Revision #0

Answer

Patch for this one, should go in the /Services/ directory of Broker. Will be included in the next 5.3 rollup release.

Unify.IdentityBroker.Agent.Api.Shared.dll

0
Not a bug

Test Harness "Copy to CSV" creates file with headers but no data

Adrian Corston 5 years ago in CSV connector updated by anonymous 5 years ago 2

When I used "Copy to CSV" from the Test Harness plugin, it creates the CSV file with headers but none of the data from the source connector.

UNIFY Identity Broker

About:UNIFY Identity Broker Management Studio
v5.2.1 Revision #0
© 2004 - 2017 UNIFY Solutions Pty. Ltd.
Answer
Curtis Lusmore 5 years ago

Hi Adrian,

This is working as intended. Please see Connector Test Harness for details on using the connector test harness.

The Copy to CSV operation can be used to add a  CSV connector with an identical schema to an existing connector. Used in conjunction with the  Add operation described below, you can also backup the existing entity context into the newly created CSV connector.
0
Declined

How to get user information from SAP in an MS SharePoint Workflow?

Elena kretova 6 years ago in CSV connector updated by Adam van Vliet 6 years ago 1

Approve so essentially I am making a Workflow BPMS in SharePoint and I need to get a client's data like his/her specialization, chief and so on into the work process. 

The work process goes this way: If a worker wishes to arrange some stationary, he/she enters the work process by topping off a frame, which is sent to their chief (who's data originates from SAP HR module) and when affirmed goes to the general organization office. 

Since SAP HR stores the parts of the clients and their associations, I need to have this data associated with my work process. 

How might I accomplish this reconciliation?

Answer
Adam van Vliet 6 years ago

Hi Elena,

We're not affiliated with Microsoft or SAP, nor do we provide support for their respective products.

If you have a question about our product set, please feel free to ask.

Thanks.

0
Fixed

Strange behaviour of CSV connector export

Matthew Clark 12 years ago in CSV connector updated by anonymous 8 years ago 7

The CSV connector is exhibiting some strange behaviour when exporting. See below a file that was written to. Telephone is a multivalue string field in the connector schema - the rest are strings.

Key,Name,EmployeeID,Telephone,Email
13,Matthew Clark,1337,another@address.com,Unify.Framework.StringValue[]
19,Anthony Sheehy,1339,tony.sheehy@unifysolutions.net,Unify.Framework.StringValue[]
100001,Josef,100001,mail@maily.com,System.Collections.Generic.List`1Unify.Framework.StringValue

Telephone and email have seemingly switched value types. I am assuming this is why the string value array writing has appeared.


CSV Export User.png
0
Fixed

CSV Connector fails export

Tony Sheehy 12 years ago in CSV connector updated by anonymous 8 years ago 21

Exports to the CSV Connector are failing with the following:

Save entities [Count:1] to connector CSV Connector 2 failed with reason The process cannot access the file 'C:\Shared\Identity Broker 4\CSV Test\Talent2 Person Connector5.csv' because it is being used by another process.. Duration: 00:00:00
Error details:
System.IO.IOException: The process cannot access the file 'C:\Shared\Identity Broker 4\CSV Test\Talent2 Person Connector5.csv' because it is being used by another process.
at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath)
at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share, Int32 bufferSize, FileOptions options)
at System.IO.StreamWriter.CreateFile(String path, Boolean append)
at System.IO.StreamWriter..ctor(String path, Boolean append, Encoding encoding, Int32 bufferSize)
at System.IO.StreamWriter..ctor(String path, Boolean append, Encoding encoding)
at System.IO.File.AppendAllLines(String path, IEnumerable`1 contents)
at Unify.Product.IdentityBroker.CsvConnector.AddEntities(IEnumerable`1 entities)
at Unify.Product.IdentityBroker.ConnectorToWritingConnectorBridge.AddEntities(IEnumerable`1 entities)
at Unify.Product.IdentityBroker.EventNotifierWritingConnectorDecorator.AddEntities(IEnumerable`1 entities)
at Unify.Product.IdentityBroker.Adapter.AddEntities(IEnumerable`1 entities, Boolean reflect)
at Unify.Product.IdentityBroker.Adapter.AddEntity(IAdapterEntity entity)
at Unify.Product.IdentityBroker.AdapterNotifierDecoratorBase`1.AddEntity(IAdapterEntity entity)
at Unify.Product.IdentityBroker.LDIFAdapterBase.ExportChanges(ExportedLDIFForAdapter exportedLdifForAdapter)
at Unify.Product.IdentityBroker.LDIFAdapterServiceHostDecoratorBase.ExportChanges(ExportedLDIFForAdapter exportedLdifForAdapter)
at SyncInvokeExportChanges(Object , Object[] , Object[] )
at System.ServiceModel.Dispatcher.SyncMethodInvoker.Invoke(Object instance, Object[] inputs, Object[]& outputs)
at System.ServiceModel.Dispatcher.DispatchOperationRuntime.InvokeBegin(MessageRpc& rpc)
at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage5(MessageRpc& rpc)
at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage41(MessageRpc& rpc)
at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage4(MessageRpc& rpc)
at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage31(MessageRpc& rpc)
at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage3(MessageRpc& rpc)
at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage2(MessageRpc& rpc)
at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage11(MessageRpc& rpc)
at System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage1(MessageRpc& rpc)
at System.ServiceModel.Dispatcher.MessageRpc.Process(Boolean isOperationContextSet)

There were a series of improvements made to the CSV connector that will need to be re-evaluated and completely regression tested. These changes were made in attempts to remove the likelihood of locks on a file being breached on the same thread by reducing the number of reads/writes to the file.

These included:

  • Preventing the collection of IConnectorEntities being completely evaluated before being written back.
  • Reducing the reads on the same file to 1 instead of 3 on Add entities.