Watson Marketing Ideas

Submit new product ideas for Digital Analytics, Tealeaf, Universal Behavior Exchange, Watson Customer Experience Analytics and Watson Marketing Insights solutions. Before you submit, please review existing ideas; if an idea close to yours already exists, it's better to add comments or vote on the existing idea. We will review your ideas and use them to help prioritize our product development. Best of all, the portal will automatically update you when the status of your idea has been changed.

Submit ideas for other Watson Customer Engagement Products:

•  Watson Campaign Automation
Watson Commerce
Watson Supply Chain

Better control over canister session indexing is needed, to reduce processing and storage cost

Tealeaf session indexing can be very costly, with index storage size commonly being twice session (LSSN) storage size, and sometimes escalating to far more. More control is required to skip indexing on content that is not meaningful for session search.

Tealeaf currently provides a mechanism for adding content types to index (i.e., "Additional Content Types to Index"), but the opposite type of control is also needed.

These options are requested, for identifying hits to skip:

  • "Content Types to Skip"
  • "File Extensions to Skip"
  • "URLs so skip" (where the URL contains any of the specified strings)

A workaround has been deployed from time to time... to "munge" the content type and have the indexer skip the hit, but this sometimes interferes with replay.

For reference, these content types are indexed by default:

    text/html
    text/plain
    text/xml
    application/xhtml+xml
    application/rdf+xml
    application/vnd.mozilla.xul+xml
    application/xml

 A hit designated to to be "skipped" for indexing would disregard these defaults, and not be indexed.

When a hit is "skipped" for indexing, standard request indexing would still be done, but the response and any JSON or XML payload in the request would not be indexed. This will help materially in AJAX heavy applications, where those data elements are not expected to be searched for directly. 

Additionally, if the DTSearch engine supports compression, and it is not already in use, enabling compression might reduce storage size. However, uncompressed storage has a storage advantage when the media supports de-duplication, so compression should also be disable-able.

  • Avatar32.5fb70cce7410889e661286fd7f1897de Guest
  • Jul 30 2018
  • Under Consideration
How will this idea be used?

Reducing the storage cost for Tealeaf improves it's value proposition, and helps with scalability. Additionally, reducing the indexing workload avoids indexing backlogs, and makes completed session searchable earlier.

What is your industry? Telecommunications
What is the idea priority? Medium
DeveloperWorks ID DW_ID0
RTC ID
Link to original RFE
  • Attach files
  • Avatar40.8f183f721a2c86cd98fddbbe6dc46ec9
    Guest commented
    August 3, 2018 22:05

    Recommend linking this with the Flash Storage encryption toggle Idea/Request.  As if we can optionally turn off software encryption, we can use newer hardware-based Flash storage systems that do all three things: Hardware supported Encryption, Compression (15% gain) and Data-Deduplication (up to 7x gain).
    https://watsonmarketing.ideas.aha.io/ideas/TLONPREM-I-12