Hardware Oriented Krylov Methods for High Performance Computing. Krylov subspace methods are an essential building block in numerical simulation software. The efficient utilization of modern hardware is a challenging problem in the development of these methods. In this work, we develop Krylov subspace methods to solve linear systems with multiple right hand sides, tailored to modern hardware in high performance computing. To this end, we analyze an innovative block Krylov subspace framework that allows to balance the computational and data transfer costs to the hardware. Based on the framework, we formulate commonly used Krylov methods. For the CG and BiCGStab methods, we introduce a novel stabilization approach as an alternative to a deflation strategy. This helps us to retain the block size, thus leading to a simpler and more efficient implementation. In addition, we optimize the methods further for distributed memory systems and the communication overhead. For the CG method, we analyze approaches to overlap the communication and computation and present multiple variants of the CG method, which differ in their communication properties. Furthermore, we present optimizations of the orthogonalization procedure in the GMRes method. Beside introducing a pipelined Gram Schmidt variant that overlaps the global communication with the computation of inner products, we present a novel orthonormalization method based on the TSQR algorithm, which is communication optimal and stable. For all optimized method, we present tests that show their superiority in a distributed setting.


Helicopter Track Identification with Autoencoder. Computing power, big data, and advancement of algorithms have led to a renewed interest in artificial intelligence (AI), especially in deep learning (DL). The success of DL largely lies on data representation because different representations can indicate to a degree the different explanatory factors of variation behind the data. In the last few year, the most successful story in DL is supervised learning. However, to apply supervised learning, one challenge is that data labels are expensive to get, noisy, or only partially available. With consideration that we human beings learn in an unsupervised way self supervised learning methods have garnered a lot of attention recently. A dominant force in self supervised learning is the autoencoder, which has multiple uses (e.g., data representation, anomaly detection, denoise). This research explored the application of an autoencoder to learn effective data representation of helicopter flight track data, and then to support helicopter track identification. Our testing results are promising. For example, at Phoenix Deer Valley (DVT) airport, where 70 of recorded flight tracks have missing aircraft types, the autoencoder can help to identify twenty two times more helicopters than otherwise detectable using rule based methods for Grand Canyon West Airport (1G4) airport, the autoencoder can identify thirteen times more helicopters than a current rule based approach. Our approach can also identify mislabeled aircraft types in the flight track data and find true types for records with pseudo aircraft type labels such as HELO. With improved labelling, studies using these data sets can produce more reliable results.


2nd Workshop on Hybrid Development Approaches in Software Systems Development. Software and system development is complex and diverse, and a multitude of development approaches is used and combined with each other to address the manifold challenges companies face today. To study the current state of the practice and to build a sound understanding about the utility of different development approaches and their application to modern software system development, in 2016, we launched the HELENA initiative. This paper introduces the 2nd HELENA workshop and provides an overview of the current project state. In the workshop, six teams present initial findings from their regions, impulse talk are given, and further steps of the HELENA roadmap are discussed.


Quantization Backdoors to Deep Learning Commercial Frameworks. Currently, there is a burgeoning demand for deploying deep learning (DL) models on ubiquitous edge Internet of Things (IoT) devices attributed to their low latency and high privacy preservation. However, DL models are often large in size and require large scale computation, which prevents them from being placed directly onto IoT devices, where resources are constrained and 32 bit floating point (float 32) operations are unavailable. Commercial framework (i.e., a set of toolkits) empowered model quantization is a pragmatic solution that enables DL deployment on mobile devices and embedded systems by effortlessly post quantizing a large high precision model (e.g., float 32) into a small low precision model (e.g., int 8) while retaining the model inference accuracy. However, their usability might be threatened by security vulnerabilities. This work reveals that the standard quantization toolkits can be abused to activate a backdoor. We demonstrate that a full precision backdoored model which does not have any backdoor effect in the presence of a trigger as the backdoor is dormant can be activated by the default i) TensorFlow Lite (TFLite) quantization, the only product ready quantization framework to date, and ii) the beta released PyTorch Mobile framework. When each of the float 32 models is converted into an int 8 format model through the standard TFLite or Pytorch Mobile framework's post training quantization, the backdoor is activated in the quantized model, which shows a stable attack success rate close to 100 upon inputs with the trigger, while it behaves normally upon non trigger inputs. This work highlights that a stealthy security threat occurs when an end user utilizes the on device post training model quantization frameworks, informing security researchers of cross platform overhaul of DL models post quantization even if these models pass front end backdoor inspections.


hybrid subconvexity bounds for twists of rm GL(3) L functions. Let pi be a SL(3, mathbb Z) Hecke Maass cusp form and chi a primitive Dirichlet character of prime power conductor mathfrak q p k with p prime. In this paper we will prove the following subconvexity bound L left( frac 1 2 it, pi times chi right) ll pi, varepsilon p 3 4 big( mathfrak q (1 t ) big) 3 4 3 40 varepsilon , for any varepsilon 0 and t in mathbb R .


Transformer Guided Geometry Model for Flow Based Unsupervised Visual Odometry. Existing unsupervised visual odometry (VO) methods either match pairwise images or integrate the temporal information using recurrent neural networks over a long sequence of images. They are either not accurate, time consuming in training or error accumulative. In this paper, we propose a method consisting of two camera pose estimators that deal with the information from pairwise images and a short sequence of images respectively. For image sequences, a Transformer like structure is adopted to build a geometry model over a local temporal window, referred to as Transformer based Auxiliary Pose Estimator (TAPE). Meanwhile, a Flow to Flow Pose Estimator (F2FPE) is proposed to exploit the relationship between pairwise images. The two estimators are constrained through a simple yet effective consistency loss in training. Empirical evaluation has shown that the proposed method outperforms the state of the art unsupervised learning based methods by a large margin and performs comparably to supervised and traditional ones on the KITTI and Malaga dataset.


Nonlinear elliptic equations with integro differential divergence form operators and measure data under sign condition on the nonlinearity. We study existence problem for semilinear equations with Borel measure data and operator generated by a symmetric Markov semigroup. We assume merely that the nonlinear part satisfies the so called sign condition. Using the method of sub and supersolutions we show the existence of maximal measure for which there exists a solution to the problem (the so called reduced measure introduced by H. Brezis, M. Marcus and A.C. Ponce).


BERT Embeddings for Automatic Readability Assessment. Automatic readability assessment (ARA) is the task of evaluating the level of ease or difficulty of text documents for a target audience. For researchers, one of the many open problems in the field is to make such models trained for the task show efficacy even for low resource languages. In this study, we propose an alternative way of utilizing the information rich embeddings of BERT models with handcrafted linguistic features through a combined method for readability assessment. Results show that the proposed method outperforms classical approaches in readability assessment using English and Filipino datasets, obtaining as high as 12.4 increase in F1 performance. We also show that the general information encoded in BERT embeddings can be used as a substitute feature set for low resource languages like Filipino with limited semantic and syntactic NLP tools to explicitly extract feature values for the task.


HIT A Hierarchically Fused Deep Attention Network for Robust Code mixed Language Representation. Understanding linguistics and morphology of resource scarce code mixed texts remains a key challenge in text processing. Although word embedding comes in handy to support downstream tasks for low resource languages, there are plenty of scopes in improving the quality of language representation particularly for code mixed languages. In this paper, we propose HIT, a robust representation learning method for code mixed texts. HIT is a hierarchical transformer based framework that captures the semantic relationship among words and hierarchically learns the sentence level semantics using a fused attention mechanism. HIT incorporates two attention modules, a multi headed self attention and an outer product attention module, and computes their weighted sum to obtain the attention weights. Our evaluation of HIT on one European (Spanish) and five Indic (Hindi, Bengali, Tamil, Telugu, and Malayalam) languages across four NLP tasks on eleven datasets suggests significant performance improvement against various state of the art systems. We further show the adaptability of learned representation across tasks in a transfer learning setup (with and without fine tuning).


Some Network Optimization Models under Diverse Uncertain Environments. Network models provide an efficient way to represent many real life problems mathematically. In the last few decades, the field of network optimization has witnessed an upsurge of interest among researchers and practitioners. The network models considered in this thesis are broadly classified into four types including transportation problem, shortest path problem, minimum spanning tree problem and maximum flow problem. Quite often, we come across situations, when the decision parameters of network optimization problems are not precise and characterized by various forms of uncertainties arising from the factors, like insufficient or incomplete data, lack of evidence, inappropriate judgements and randomness. Considering the deterministic environment, there exist several studies on network optimization problems. However, in the literature, not many investigations on single and multi objective network optimization problems are observed under diverse uncertain frameworks. This thesis proposes seven different network models under different uncertain paradigms. Here, the uncertain programming techniques used to formulate the uncertain network models are (i) expected value model, (ii) chance constrained model and (iii) dependent chance constrained model. Subsequently, the corresponding crisp equivalents of the uncertain network models are solved using different solution methodologies. The solution methodologies used in this thesis can be broadly categorized as classical methods and evolutionary algorithms. The classical methods, used in this thesis, are Dijkstra and Kruskal algorithms, modified rough Dijkstra algorithm, global criterion method, epsilon constraint method and fuzzy programming method. Whereas, among the evolutionary algorithms, we have proposed the varying population genetic algorithm with indeterminate crossover and considered two multi objective evolutionary algorithms.


Duality for convex infinite optimization on linear spaces. This note establishes a limiting formula for the conic Lagrangian dual of a convex infinite optimization problem, correcting the classical version of Karney Math. Programming 27 (1983) 75 82 for convex semi infinite programs. A reformulation of the convex infinite optimization problem with a single constraint leads to a limiting formula for the corresponding Lagrangian dual, called sup dual, and also for the primal problem in the case when strong Slater condition holds, which also entails strong sup duality.


PSGR Pixel wise Sparse Graph Reasoning for COVID 19 Pneumonia Segmentation in CT Images. Automated and accurate segmentation of the infected regions in computed tomography (CT) images is critical for the prediction of the pathological stage and treatment response of COVID 19. Several deep convolutional neural networks (DCNNs) have been designed for this task, whose performance, however, tends to be suppressed by their limited local receptive fields and insufficient global reasoning ability. In this paper, we propose a pixel wise sparse graph reasoning (PSGR) module and insert it into a segmentation network to enhance the modeling of long range dependencies for COVID 19 infected region segmentation in CT images. In the PSGR module, a graph is first constructed by projecting each pixel on a node based on the features produced by the segmentation backbone, and then converted into a sparsely connected graph by keeping only K strongest connections to each uncertain pixel. The long range information reasoning is performed on the sparsely connected graph to generate enhanced features. The advantages of this module are two fold (1) the pixel wise mapping strategy not only avoids imprecise pixel to node projections but also preserves the inherent information of each pixel for global reasoning and (2) the sparsely connected graph construction results in effective information retrieval and reduction of the noise propagation. The proposed solution has been evaluated against four widely used segmentation models on three public datasets. The results show that the segmentation model equipped with our PSGR module can effectively segment COVID 19 infected regions in CT images, outperforming all other competing models.


Explaining Reward Functions to Humans for Better Human Robot Collaboration. Explainable AI techniques that describe agent reward functions can enhance human robot collaboration in a variety of settings. One context where human understanding of agent reward functions is particularly beneficial is in the value alignment setting. In the value alignment context, an agent aims to infer a human's reward function through interaction so that it can assist the human with their tasks. If the human can understand where gaps exist in the agent's reward understanding, they will be able to teach more efficiently and effectively, leading to quicker human agent team performance improvements. In order to support human collaborators in the value alignment setting and similar contexts, it is first important to understand the effectiveness of different reward explanation techniques in a variety of domains. In this paper, we introduce a categorization of information modalities for reward explanation techniques, suggest a suite of assessment techniques for human reward understanding, and introduce four axes of domain complexity. We then propose an experiment to study the relative efficacy of a broad set of reward explanation techniques covering multiple modalities of information in a set of domains of varying complexity.


Real time Bangla License Plate Recognition System for Low Resource Video based Applications. Automatic License Plate Recognition systems aim to provide a solution for detecting, localizing, and recognizing license plate characters from vehicles appearing in video frames. However, deploying such systems in the real world requires real time performance in low resource environments. In our paper, we propose a two stage detection pipeline paired with Vision API that provides real time inference speed along with consistently accurate detection and recognition performance. We used a haar cascade classifier as a filter on top of our backbone MobileNet SSDv2 detection model. This reduces inference time by only focusing on high confidence detections and using them for recognition. We also impose a temporal frame separation strategy to distinguish between multiple vehicle license plates in the same clip. Furthermore, there are no publicly available Bangla license plate datasets, for which we created an image dataset and a video dataset containing license plates in the wild. We trained our models on the image dataset and achieved an AP(0.5) score of 86 and tested our pipeline on the video dataset and observed reasonable detection and recognition performance (82.7 detection rate, and 60.8 OCR F1 score) with real time processing speed (27.2 frames per second).


Reaching Consensus for Asynchronous Distributed Key Generation. We give a protocol for Asynchronous Distributed Key Generation (A DKG) that is optimally resilient (can withstand f frac n 3 faulty parties), has a constant expected number of rounds, has tilde O (n 3) expected communication complexity, and assumes only the existence of a PKI. Prior to our work, the best A DKG protocols required Omega(n) expected number of rounds, and Omega(n 4) expected communication. Our A DKG protocol relies on several building blocks that are of independent interest. We define and design a Proposal Election (PE) protocol that allows parties to retrospectively agree on a valid proposal after enough proposals have been sent from different parties. With constant probability the elected proposal was proposed by a non faulty party. In building our PE protocol, we design a Verifiable Gather protocol which allows parties to communicate which proposals they have and have not seen in a verifiable manner. The final building block to our A DKG is a Validated Asynchronous Byzantine Agreement (VABA) protocol. We use our PE protocol to construct a VABA protocol that does not require leaders or an asynchronous DKG setup. Our VABA protocol can be used more generally when it is not possible to use threshold signatures.


Discrete potential mean field games. We propose and investigate a general class of discrete time and finite state space mean field game (MFG) problems with potential structure. Our model incorporates interactions through a congestion term and a price variable. It also allows hard constraints on the distribution of the agents. We analyze the connection between the MFG problem and two optimal control problems in duality. We present two families of numerical methods and detail their implementation (i) primal dual proximal methods (and their extension with nonlinear proximity operators), (ii) the alternating direction method of multipliers (ADMM) and a variant called ADM G. We give some convergence results. Numerical results are provided for two examples with hard constraints.


Monolayer H Si P Semiconductors Structural stability, electronic structure, optical properties, and Prospects for photocatalytic water splitting. Group IV and V monolayers are the promising state of the art 2D materials owing to their high carrier mobility, tunable bandgaps, and optical linear dichroism along with outstanding electronic and thermoelectric properties. Furthermore, recent studies reveal the stability of free standing 2D monolayers by hydrogenation. Inspired by this, we systematically predict and investigate the structure and properties of various hydrogen saturated silicon phosphide (H Si P) monolayers, based on first principles calculations. According to the results, H Si P monolayers belong to indirect bandgap semiconductors with a highly stable structure. Their bandgaps and band edge positions assessed using accurate hybrid functional are shown to be effectively adjusted by applying a biaxial strain. Furthermore, the absorption spectra of these monolayers, simulated in the context of time dependent density functional theory, exhibit their excellent potential for solar energy conversion and visible light driven photocatalytic water splitting. In this respect, this work provides valuable guidance for finding more 2D semiconductors and nanostructures for nanoelectronic and optoelectronic applications, as well as for photocatalytic water splitting.


Studying Duplicate Logging Statements and Their Relationships with Code Clones. In this paper, we focus on studying duplicate logging statements, which are logging statements that have the same static text message. We manually studied over 4K duplicate logging statements and their surrounding code in five large scale open source systems. We uncovered five patterns of duplicate logging code smells. For each instance of the duplicate logging code smell, we further manually identify the potentially problematic and justifiable cases. Then, we contact developers to verify our manual study result. We integrated our manual study result and the feedback of developers into our automated static analysis tool, DLFinder, which automatically detects problematic duplicate logging code smells. We evaluated DLFinder on the five manually studied systems and three additional systems. In total, combining the results of DLFinder and our manual analysis, we reported 91 problematic duplicate logging code smell instances to developers and all of them have been fixed. We further study the relationship between duplicate logging statements, including the problematic instances of duplicate logging code smells, and code clones. We find that 83 of the duplicate logging code smell instances reside in cloned code, but 17 of them reside in micro clones that are difficult to detect using automated clone detection tools. We also find that more than half of the duplicate logging statements reside in cloned code snippets, and a large portion of them reside in very short code blocks which may not be effectively detected by existing code clone detection tools. Our study shows that, in addition to general source code that implements the business logic, code clones may also result in bad logging practices that could increase maintenance difficulties.


Harmonic Hermitian structures on Riemannian manifolds with skew torsion. We find geometric conditions on a four dimensional Hermitian manifold endowed with a metric connection with totally skew symmetric torsion under which the complex structure is a harmonic map from the manifold into its twistor space considered with a natural family of Riemannian metrics defined by means of the metric and the given connection on the base manifold.


Fast Sampling from Time Integrated Bridges using Deep Learning. We propose a methodology to sample from time integrated stochastic bridges, namely random variables defined as int t 1 t 2 f(Y(t))dt conditioned on Y(t 1) ! !a and Y(t 2) ! !b , with a,b in R . The Stochastic Collocation Monte Carlo sampler and the Seven League scheme are applied for this purpose. Notably, the distribution of the time integrated bridge is approximated utilizing a polynomial chaos expansion built on a suitable set of stochastic collocation points. Furthermore, artificial neural networks are employed to learn the collocation points. The result is a robust, data driven procedure for the Monte Carlo sampling from conditional time integrated processes, which guarantees high accuracy and generates thousands of samples in milliseconds. Applications, with a focus on finance, are presented here as well.


Cross Level Cross Scale Cross Attention Network for Point Cloud Representation. Self attention mechanism recently achieves impressive advancement in Natural Language Processing (NLP) and Image Processing domains. And its permutation invariance property makes it ideally suitable for point cloud processing. Inspired by this remarkable success, we propose an end to end architecture, dubbed Cross Level Cross Scale Cross Attention Network (CLCSCANet), for point cloud representation learning. First, a point wise feature pyramid module is introduced to hierarchically extract features from different scales or resolutions. Then a cross level cross attention is designed to model long range inter level and intra level dependencies. Finally, we develop a cross scale cross attention module to capture interactions between and within scales for representation enhancement. Compared with state of the art approaches, our network can obtain competitive performance on challenging 3D object classification, point cloud segmentation tasks via comprehensive experimental evaluation.


Triple covers of K3 surfaces. We study triple covers of K3 surfaces, following Miranda's theory of triple covers. We relate the geometry of the covering surfaces with the properties of both the branch locus and the Tschirnhausen vector bundle. In particular, we classify Galois triple covers computing numerical invariants of the covering surface and of its minimal model. We provide examples of non Galois triple covers, both in the case in which the Tschirnhausen bundle splits into the sum of two line bundles and in the case in which it is an indecomposable rank 2 vector bundle. We provide a criterion to construct rank 2 vector bundles on a K3 surface S which determine a non Galois triple cover of S . The examples presented are in any admissible Kodaira dimension and in particular we provide the constructions of irregular covers of K3 surfaces and of surfaces with geometrical genus equal to 2 whose transcendental Hodge structure splits in the sum of two Hodge structures of K3 type.


Pyramid Adversarial Training Improves ViT Performance. Aggressive data augmentation is a key component of the strong generalization capabilities of Vision Transformer (ViT). One such data augmentation technique is adversarial training however, many prior works have shown that this often results in poor clean accuracy. In this work, we present Pyramid Adversarial Training, a simple and effective technique to improve ViT's overall performance. We pair it with a "matched" Dropout and stochastic depth regularization, which adopts the same Dropout and stochastic depth configuration for the clean and adversarial samples. Similar to the improvements on CNNs by AdvProp (not directly applicable to ViT), our Pyramid Adversarial Training breaks the trade off between in distribution accuracy and out of distribution robustness for ViT and related architectures. It leads to 1.82 absolute improvement on ImageNet clean accuracy for the ViT B model when trained only on ImageNet 1K data, while simultaneously boosting performance on 7 ImageNet robustness metrics, by absolute numbers ranging from 1.76 to 11.45 . We set a new state of the art for ImageNet C (41.4 mCE), ImageNet R ( 53.92 ), and ImageNet Sketch ( 41.04 ) without extra data, using only the ViT B 16 backbone and our Pyramid Adversarial Training. Our code will be publicly available upon acceptance.


Character sheaves for symmetric pairs special linear groups. We give an explicit description of character sheaves for the symmetric pairs associated to inner involutions of the special linear groups. We make use of the general strategy given in VX1 and central character consideration. We also determine the cuspidal character sheaves.


Sequential Voting with Relational Box Fields for Active Object Detection. A key component of understanding hand object interactions is the ability to identify the active object the object that is being manipulated by the human hand. In order to accurately localize the active object, any method must reason using information encoded by each image pixel, such as whether it belongs to the hand, the object, or the background. To leverage each pixel as evidence to determine the bounding box of the active object, we propose a pixel wise voting function. Our pixel wise voting function takes an initial bounding box as input and produces an improved bounding box of the active object as output. The voting function is designed so that each pixel inside of the input bounding box votes for an improved bounding box, and the box with the majority vote is selected as the output. We call the collection of bounding boxes generated inside of the voting function, the Relational Box Field, as it characterizes a field of bounding boxes defined in relationship to the current bounding box. While our voting function is able to improve the bounding box of the active object, one round of voting is typically not enough to accurately localize the active object. Therefore, we repeatedly apply the voting function to sequentially improve the location of the bounding box. However, since it is known that repeatedly applying a one step predictor (i.e., auto regressive processing with our voting function) can cause a data distribution shift, we mitigate this issue using reinforcement learning (RL). We adopt standard RL to learn the voting function parameters and show that it provides a meaningful improvement over a standard supervised learning approach. We perform experiments on two large scale datasets 100DOH and MECCANO, improving AP50 performance by 8 and 30 , respectively, over the state of the art.


Memory Aware Partitioning of Machine Learning Applications for Optimal Energy Use in Batteryless Systems. Sensing systems powered by energy harvesting have traditionally been designed to tolerate long periods without energy. As the Internet of Things (IoT) evolves towards a more transient and opportunistic execution paradigm, reducing energy storage costs will be key for its economic and ecologic viability. However, decreasing energy storage in harvesting systems introduces reliability issues. Transducers only produce intermittent energy at low voltage and current levels, making guaranteed task completion a challenge. Existing ad hoc methods overcome this by buffering enough energy either for single tasks, incurring large data retention overheads, or for one full application cycle, requiring a large energy buffer. We present Julienning an automated method for optimizing the total energy cost of batteryless applications. Using a custom specification model, developers can describe transient applications as a set of atomically executed kernels with explicit data dependencies. Our optimization flow can partition data and energy intensive applications into multiple execution cycles with bounded energy consumption. By leveraging interkernel data dependencies, these energy bounded execution cycles minimize the number of system activations and nonvolatile data transfers, and thus the total energy overhead. We validate our methodology with two batteryless cameras running energy intensive machine learning applications. Results demonstrate that compared to ad hoc solutions, our method can reduce the required energy storage by over 94 while only incurring a 0.12 energy overhead.


Topological description of the Borel probability space. We study properties of some popular topology on the space of Borel probabilities on a topological ambient space in this paper. We show that the two types of popular vague topology are equivalent to each other in case the ambient space is LCH. The two types of setwise topology induced from two equivalent descriptions of setwisely sequential convergence of probability measures are also equivalent to each other regardless of the topology on the ambient space. We give explicit conditions for the two types of vague topology and the two types of setwise topology to be separable or metrizable on the space of Borel probabilities. These conditions are either in terms of the cardinality of the elementary events in the Borel sigma algebra or some direct topological assumptions on the ambient space. We give an necessary and sufficient condition for families of probability measures to be setwisely relatively compact in case the ambient space is a compact metric space. There are some extending problems and heuristic schemes on formulating new topologies on the space of Borel probabilities at the end of the work.


Learning Space Partitions for Path Planning. Path planning, the problem of efficiently discovering high reward trajectories, often requires optimizing a high dimensional and multimodal reward function. Popular approaches like CEM and CMA ES greedily focus on promising regions of the search space and may get trapped in local maxima. DOO and VOOT balance exploration and exploitation, but use space partitioning strategies independent of the reward function to be optimized. Recently, LaMCTS empirically learns to partition the search space in a reward sensitive manner for black box optimization. In this paper, we develop a novel formal regret analysis for when and why such an adaptive region partitioning scheme works. We also propose a new path planning method LaP3 which improves the function value estimation within each sub region, and uses a latent representation of the search space. Empirically, LaP3 outperforms existing path planning methods in 2D navigation tasks, especially in the presence of difficult to escape local optima, and shows benefits when plugged into the planning components of model based RL such as PETS. These gains transfer to highly multimodal real world tasks, where we outperform strong baselines in compiler phase ordering by up to 39 on average across 9 tasks, and in molecular design by up to 0.4 on properties on a 0 1 scale. Code is available at https github.com yangkevin2 neurips2021 lap3.


EX RAY Distinguishing Injected Backdoor from Natural Features in Neural Networks by Examining Differential Feature Symmetry. Backdoor attack injects malicious behavior to models such that inputs embedded with triggers are misclassified to a target label desired by the attacker. However, natural features may behave like triggers, causing misclassification once embedded. While they are inevitable, mis recognizing them as injected triggers causes false warnings in backdoor scanning. A prominent challenge is hence to distinguish natural features and injected backdoors. We develop a novel symmetric feature differencing method that identifies a smallest set of features separating two classes. A backdoor is considered injected if the corresponding trigger consists of features different from the set of features distinguishing the victim and target classes. We evaluate the technique on thousands of models, including both clean and trojaned models, from the TrojAI rounds 2 4 competitions and a number of models on ImageNet. Existing backdoor scanning techniques may produce hundreds of false positives (i.e., clean models recognized as trojaned). Our technique removes 78 100 of the false positives (by a state of the art scanner ABS) with a small increase of false negatives by 0 30 , achieving 17 41 overall accuracy improvement, and facilitates achieving top performance on the leaderboard. It also boosts performance of other scanners. It outperforms false positive removal methods using L2 distance and attribution techniques. We also demonstrate its potential in detecting a number of semantic backdoor attacks.


On directional convolution equivalent densities. We propose a definition of directional multivariate subexponential and convolution equivalent densities and find a useful characterization of these notions for a class of integrable and almost radial decreasing functions. We apply this result to show that the density of the absolutely continuous part of the compound Poisson measure built on a given density f is directionally convolution equivalent and inherits its asymptotic behaviour from f if and only if f is directionally convolution equivalent. We also extend this characterization to the densities of more general infinitely divisible distributions on mathbb R d , d geq 1 , which are not pure compound Poisson.


Mesh Reconstruction from Aerial Images for Outdoor Terrain Mapping Using Joint 2D 3D Learning. This paper addresses outdoor terrain mapping using overhead images obtained from an unmanned aerial vehicle. Dense depth estimation from aerial images during flight is challenging. While feature based localization and mapping techniques can deliver real time odometry and sparse points reconstruction, a dense environment model is generally recovered offline with significant computation and storage. This paper develops a joint 2D 3D learning approach to reconstruct local meshes at each camera keyframe, which can be assembled into a global environment model. Each local mesh is initialized from sparse depth measurements. We associate image features with the mesh vertices through camera projection and apply graph convolution to refine the mesh vertices based on joint 2 D reprojected depth and 3 D mesh supervision. Quantitative and qualitative evaluations using real aerial images show the potential of our method to support environmental monitoring and surveillance applications.


Position Bias Mitigation A Knowledge Aware Graph Model for Emotion Cause Extraction. The Emotion Cause Extraction (ECE) task aims to identify clauses which contain emotion evoking information for a particular emotion expressed in text. We observe that a widely used ECE dataset exhibits a bias that the majority of annotated cause clauses are either directly before their associated emotion clauses or are the emotion clauses themselves. Existing models for ECE tend to explore such relative position information and suffer from the dataset bias. To investigate the degree of reliance of existing ECE models on clause relative positions, we propose a novel strategy to generate adversarial examples in which the relative position information is no longer the indicative feature of cause clauses. We test the performance of existing models on such adversarial examples and observe a significant performance drop. To address the dataset bias, we propose a novel graph based method to explicitly model the emotion triggering paths by leveraging the commonsense knowledge to enhance the semantic dependencies between a candidate clause and an emotion clause. Experimental results show that our proposed approach performs on par with the existing state of the art methods on the original ECE dataset, and is more robust against adversarial attacks compared to existing models.


An Uncertainty aware Hierarchical Probabilistic Network for Early Prediction, Quantification and Segmentation of Pulmonary Tumour Growth. Early detection and quantification of tumour growth would help clinicians to prescribe more accurate treatments and provide better surgical planning. However, the multifactorial and heterogeneous nature of lung tumour progression hampers identification of growth patterns. In this study, we present a novel method based on a deep hierarchical generative and probabilistic framework that, according to radiological guidelines, predicts tumour growth, quantifies its size and provides a semantic appearance of the future nodule. Unlike previous deterministic solutions, the generative characteristic of our approach also allows us to estimate the uncertainty in the predictions, especially important for complex and doubtful cases. Results of evaluating this method on an independent test set reported a tumour growth balanced accuracy of 74 , a tumour growth size MAE of 1.77 mm and a tumour segmentation Dice score of 78 . These surpassed the performances of equivalent deterministic and alternative generative solutions (i.e. probabilistic U Net, Bayesian test dropout and Pix2Pix GAN) confirming the suitability of our approach.


An In Depth Investigation of Performance Characteristics of Hyperledger Fabric. Private permissioned blockchains, such as Hyperledger Fabric, are widely deployed across the industry to facilitate cross organizational processes and promise improved performance compared to their public counterparts. However, the lack of empirical and theoretical results prevent precise prediction of the real world performance. We address this gap by conducting an in depth performance analysis of Hyperledger Fabric. The paper presents a detailed compilation of various performance characteristics using an enhanced version of the Distributed Ledger Performance Scan. Researchers and practitioners alike can use the results as guidelines to better configure and implement their blockchains and utilize the DLPS framework to conduct their measurements.


A curated dataset for data driven turbulence modelling. The recent surge in machine learning augmented turbulence modelling is a promising approach for addressing the limitations of Reynolds averaged Navier Stokes (RANS) models. This work presents the development of the first open source dataset, curated and structured for immediate use in machine learning augmented turbulence closure modelling. The dataset features a variety of RANS simulations with matching direct numerical simulation (DNS) and large eddy simulation (LES) data. Four turbulence models are selected to form the initial dataset k varepsilon , k varepsilon phi t f , k omega , and k omega SST. The dataset consists of 29 cases per turbulence model, for several parametrically sweeping reference DNS LES cases periodic hills, square duct, parametric bumps, converging diverging channel, and a curved backward facing step. At each of the 895,640 points, various RANS features with DNS LES labels are available. The feature set includes quantities used in current state of the art models, and additional fields which enable the generation of new feature sets. The dataset reduces effort required to train, test, and benchmark new models. The dataset is available at https doi.org 10.34740 kaggle dsv 2044393 .


Groups of piecewise isometric permutations of lattice points or finitary rearrangements of tessellations. Through the glasses of didactic reduction We consider a (periodic) tessellation Delta of either Euclidean or hyperbolic n space M . By a piecewise isometric rearrangement of Delta we mean the process of cutting M along corank 1 tile faces into finitely many convex polyhedral pieces, and rearranging the pieces to a new tight covering of the tessellation Delta . Such a rearrangement defines a permutation of the (centers of the) tiles of Delta , and we are interested in the group PI( Delta) of all piecewise isometric rearrangements of Delta . In this paper we offer a) An illustration of piecewise isometric rearrangements in the visually attractive hyperbolic plane, b) an explanation how this is related to Richard Thompson's groups, c) a chapter on the structure of the group pei ( mathbb Z n) of all piecewise Euclidean rearrangements of the standard tessellation of mathbb R n by unit cubes, and d) results on the finiteness properties of some subgroups of pei ( mathbb Z n) .


Monostable pulled fronts and logarithmic drifts. In this work we investigate the issue of logarithmic drifts in the position of the level sets of solutions of monostable reaction diusion equations, with respect to the traveling front with minimal speed. On the one hand, it is a celebrated result of Bramson that such a logarithmic drift occurs when the reaction is of the KPP (or sublinear) type. On the other hand, it is also known that this drift phenomenon disappears when the minimal front speed is nonlinearly determined. However, some monostable reaction diusion equations fall in neither of those cases and our aim is to fill that gap. We prove that a logarithmic drift always occurs when the speed is linearly determined, but surprisingly we find that the factor in front of the logarithmic term may be different from the KPP case.


Calibrating hypersonic turbulence flow models with the HIFiRE 1 experiment using data driven machine learned models. In this paper we study the efficacy of combining machine learning methods with projection based model reduction techniques for creating data driven surrogate models of computationally expensive, high fidelity physics models. Such surrogate models are essential for many query applications e.g., engineering design optimization and parameter estimation, where it is necessary to invoke the high fidelity model sequentially, many times. Surrogate models are usually constructed for individual scalar quantities. However there are scenarios where a spatially varying field needs to be modeled as a function of the model's input parameters. We develop a method to do so, using projections to represent spatial variability while a machine learned model captures the dependence of the model's response on the inputs. The method is demonstrated on modeling the heat flux and pressure on the surface of the HIFiRE 1 geometry in a Mach 7.16 turbulent flow. The surrogate model is then used to perform Bayesian estimation of freestream conditions and parameters of the SST (Shear Stress Transport) turbulence model embedded in the high fidelity (Reynolds Averaged Navier Stokes) flow simulator, using wind tunnel data. The paper provides the first ever Bayesian calibration of a turbulence model for complex hypersonic turbulent flows. We find that the primary issues in estimating the SST model parameters are the limited information content of the heat flux and pressure measurements and the large model form error encountered in a certain part of the flow.


A Framework for Energy and Carbon Footprint Analysis of Distributed and Federated Edge Learning. Recent advances in distributed learning raise environmental concerns due to the large energy needed to train and move data to from data centers. Novel paradigms, such as federated learning (FL), are suitable for decentralized model training across devices or silos that simultaneously act as both data producers and learners. Unlike centralized learning (CL) techniques, relying on big data fusion and analytics located in energy hungry data centers, in FL scenarios devices collaboratively train their models without sharing their private data. This article breaks down and analyzes the main factors that influence the environmental footprint of FL policies compared with classical CL Big Data algorithms running in data centers. The proposed analytical framework takes into account both learning and communication energy costs, as well as the carbon equivalent emissions in addition, it models both vanilla and decentralized FL policies driven by consensus. The framework is evaluated in an industrial setting assuming a real world robotized workplace. Results show that FL allows remarkable end to end energy savings (30 40 ) for wireless systems characterized by low bit Joule efficiency (50 kbit Joule or lower). Consensus driven FL does not require the parameter server and further reduces emissions in mesh networks (200 kbit Joule). On the other hand, all FL policies are slower to converge when local data are unevenly distributed (often 2x slower than CL). Energy footprint and learning loss can be traded off to optimize efficiency.


Weak and Strong Convergence of Generalized Proximal Point Algorithms with Relaxed Parameters. In this work, we propose and study a framework of generalized proximal point algorithms associated with a maximally monotone operator. We indicate sufficient conditions on the regularization and relaxation parameters of generalized proximal point algorithms for the equivalence of the boundedness of the sequence of iterations generated by this algorithm and the non emptiness of the zero set of the maximally monotone operator, and for the weak and strong convergence of the algorithm. Our results cover or improve many results on generalized proximal point algorithms in our references. Improvements of our results are illustrated by comparing our results with related known ones.


SIRE Separate Intra and Inter sentential Reasoning for Document level Relation Extraction. Document level relation extraction has attracted much attention in recent years. It is usually formulated as a classification problem that predicts relations for all entity pairs in the document. However, previous works indiscriminately represent intra and inter sentential relations in the same way, confounding the different patterns for predicting them. Besides, they create a document graph and use paths between entities on the graph as clues for logical reasoning. However, not all entity pairs can be connected with a path and have the correct logical reasoning paths in their graph. Thus many cases of logical reasoning cannot be covered. This paper proposes an effective architecture, SIRE, to represent intra and inter sentential relations in different ways. We design a new and straightforward form of logical reasoning module that can cover more logical reasoning chains. Experiments on the public datasets show SIRE outperforms the previous state of the art methods. Further analysis shows that our predictions are reliable and explainable. Our code is available at https github.com DreamInvoker SIRE.


Multi modal Bifurcated Network for Depth Guided Image Relighting. Image relighting aims to recalibrate the illumination setting in an image. In this paper, we propose a deep learning based method called multi modal bifurcated network (MBNet) for depth guided image relighting. That is, given an image and the corresponding depth maps, a new image with the given illuminant angle and color temperature is generated by our network. This model extracts the image and the depth features by the bifurcated network in the encoder. To use the two features effectively, we adopt the dynamic dilated pyramid modules in the decoder. Moreover, to increase the variety of training data, we propose a novel data process pipeline to increase the number of the training data. Experiments conducted on the VIDIT dataset show that the proposed solution obtains the textbf 1 st place in terms of SSIM and PMS in the NTIRE 2021 Depth Guide One to one Relighting Challenge.


SPA GCN Efficient and Flexible GCN Accelerator with an Application for Graph Similarity Computation. While there have been many studies on hardware acceleration for deep learning on images, there has been a rather limited focus on accelerating deep learning applications involving graphs. The unique characteristics of graphs, such as the irregular memory access and dynamic parallelism, impose several challenges when the algorithm is mapped to a CPU or GPU. To address these challenges while exploiting all the available sparsity, we propose a flexible architecture called SPA GCN for accelerating Graph Convolutional Networks (GCN), the core computation unit in deep learning algorithms on graphs. The architecture is specialized for dealing with many small graphs since the graph size has a significant impact on design considerations. In this context, we use SimGNN, a neural network based graph matching algorithm, as a case study to demonstrate the effectiveness of our architecture. The experimental results demonstrate that SPA GCN can deliver a high speedup compared to a multi core CPU implementation and a GPU implementation, showing the efficiency of our design.


Generalized Appell polynomials and Fueter Bargmann transforms in the polyanalytic setting. Tnis paper deals with some special integral transforms in the setting of quaternionic valued slice polyanalytic functions. In particular, using the polyanalytic Fueter mappings it is possible to construct a new family of polynomials which are called the generalized Appell polynomials. Furthermore, the range of the polyanalytic Fueter mappings on two different polyanalytic Fock spaces is characterized. Finally, we study the polyanalytic Fueter Bargmann transforms.


Weighted maximal L q (L p ) regularity theory for time fractional diffusion wave equations with variable coefficients. We present a maximal L q (L p ) regularity theory with Muckenhoupt weights for the equation begin equation label eqn 01.26.16 00 partial alpha t u a ij (t,x)u x i x j (t,x) f(t,x), quad t 0,x in mathbb R d . end equation Here, partial alpha t is the Caputo fractional derivative of order alpha in(0,2) and a ij are functions of (t,x) . Precisely, we show that begin equation begin aligned int 0 T left( int mathbb R d (1 Delta) gamma 2 u xx (t,x) p w 1 (x)dx right) q p w 2 (t)dt quad leq N int 0 T left( int mathbb R d (1 Delta) gamma 2 f(t,x) p w 1 (x)dx right) q p w 2 (t)dt, end aligned end equation where 1 p,q infty , gamma in mathbb R , and w 1 and w 2 are Muckenhoupt weights, and this implies that we prove maximal regularity theory. Our approach is based on Fourier multiplier and singular integral theory with Muckenhoupt weights. Also, we use abstract interpolation theory to find interpolation inequality in weighted Sobolev space.


A new approach to rotational Weingarten surfaces. Weingarten surfaces are those whose principal curvatures satisfy a functional relation, whose set of solutions is called the curvature diagram or the W diagram of the surface. Making use of the notion of geometric linear momentum of a plane curve, we propose a new approach to the study of rotational Weingarten surfaces in Euclidean 3 space. Our contribution consists of reducing any type of Weingarten condition on a rotational surface to a first order differential equation on the momentum of the generatrix curve. In this line, we provide two new classification results involving a cubic and an hyperbola in the W diagram of the surface characterizing, respectively, the non degenerated quadric surfaces of revolution and the elasticoids, defined as the rotational surfaces generated by the rotation of the Euler elastic curves around their directrix line. As another application of our approach, we deal with the problem of prescribing mean or Gauss curvature on rotational surfaces in terms of arbitrary continuous functions depending on distance from the surface to the axis of revolution. As a consequence, we provide simple new proofs of some classical results concerning rotational surfaces, like Euler's theorem about minimal ones, Delaunay's theorem on constant mean curvature ones, and Darboux's theorem about constant Gauss curvature ones.


Towards automatic identification of linguistic politeness in Hindi texts. In this paper I present a classifier for automatic identification of linguistic politeness in Hindi texts. I have used the manually annotated corpus of over 25,000 blog comments to train an SVM. Making use of the discursive and interactional approaches to politeness the paper gives an exposition of the normative, conventionalised politeness structures of Hindi. It is seen that using these manually recognised structures as features in training the SVM significantly improves the performance of the classifier on the test set. The trained system gives a significantly high accuracy of over 77 which is within 2 of human accuracy.


On the singularities of Mishchenko Fomenko systems. To each complex semisimple Lie algebra mathfrak g and regular element a in mathfrak g text reg , one associates a Mishchenko Fomenko subalgebra mathcal F a subseteq mathbb C mathfrak g . This subalgebra amounts to a completely integrable system on the Poisson variety mathfrak g , and as such has a bifurcation diagram Sigma a subseteq mathrm Spec ( mathcal F a) . We prove that Sigma a has codimension one in mathrm Spec ( mathcal F a) if a in mathfrak g text reg is not nilpotent, and that it has codimension one or two if a in mathfrak g text reg is nilpotent. In the nilpotent case, we show each of the possible codimensions to be achievable. Our results significantly sharpen existing estimates of the codimension of Sigma a .


Supervised Machine Learning with Plausible Deniability. We study the question of how well machine learning (ML) models trained on a certain data set provide privacy for the training data, or equivalently, whether it is possible to reverse engineer the training data from a given ML model. While this is easy to answer negatively in the most general case, it is interesting to note that the protection extends over non recoverability towards plausible deniability Given an ML model f , we show that one can take a set of purely random training data, and from this define a suitable learning rule'' that will produce a ML model that is exactly f . Thus, any speculation about which data has been used to train f is deniable upon the claim that any other data could have led to the same results. We corroborate our theoretical finding with practical examples, and open source implementations of how to find the learning rules for a chosen set of raining data.


HerBERT Efficiently Pretrained Transformer based Language Model for Polish. BERT based models are currently used for solving nearly all Natural Language Processing (NLP) tasks and most often achieve state of the art results. Therefore, the NLP community conducts extensive research on understanding these models, but above all on designing effective and efficient training procedures. Several ablation studies investigating how to train BERT like models have been carried out, but the vast majority of them concerned only the English language. A training procedure designed for English does not have to be universal and applicable to other especially typologically different languages. Therefore, this paper presents the first ablation study focused on Polish, which, unlike the isolating English language, is a fusional language. We design and thoroughly evaluate a pretraining procedure of transferring knowledge from multilingual to monolingual BERT based models. In addition to multilingual model initialization, other factors that possibly influence pretraining are also explored, i.e. training objective, corpus size, BPE Dropout, and pretraining length. Based on the proposed procedure, a Polish BERT based language model HerBERT is trained. This model achieves state of the art results on multiple downstream tasks.


On the number of invariant measures for random expanding maps in higher dimensions. In cite J , Jab l o ' n ski proved that a piecewise expanding C 2 multidimensional Jab l o ' n ski map admits an absolutely continuous invariant probability measure (ACIP). In cite BL , Boyarsky and Lou extended this result to the case of i.i.d. compositions of the above maps, with an on average expanding condition. We generalize these results to the (quenched) setting of random Jab l o ' n ski maps, where the randomness is governed by an ergodic, invertible and measure preserving transformation. We prove that the skew product associated to this random dynamical system admits a finite number of ergodic ACIPs. Furthermore, we provide two different upper bounds on the number of mutually singular ergodic ACIP's, motivated by the works of Buzzi cite B in one dimension and Gora, Boyarsky and Proppe cite GBP in higher dimensions.


Li Yau Inequalities for Dunkl Heat Equations. Motivated by recent works due to Yu Zhao J. Geom. Anal. 2020 and Weber Zacher arXiv 2012.12974 , we study Li Yau inequalities for the heat equation corresponding to the Dunkl Laplacian, which is a non local operator parameterized by reflection groups and multiplicity functions. The results are sharp in the particular case when the reflection group is isometric to mathbb Z 2 d .


A convergent finite volume scheme for the stochastic barotropic compressible Euler equations. In this paper, we analyze a semi discrete finite volume scheme for the three dimensional barotropic compressible Euler equations driven by a multiplicative Brownian noise. We derive necessary a priori estimates for numerical approximations, and show that the Young measure generated by the numerical approximations converge to a dissipative measure valued martingale solution to the stochastic compressible Euler system. These solutions are probabilistically weak in the sense that the driving noise and associated filtration are integral part of the solution. Moreover, we demonstrate strong convergence of numerical solutions to the regular solution of the limit systems at least on the lifespan of the latter, thanks to the weak (measure valued) strong uniqueness principle for the underlying system. To the best of our knowledge, this is the first attempt to prove the convergence of numerical approximations for the underlying system.


Hybrid Mutimodal Fusion for Dimensional Emotion Recognition. In this paper, we extensively present our solutions for the MuSe Stress sub challenge and the MuSe Physio sub challenge of Multimodal Sentiment Challenge (MuSe) 2021. The goal of MuSe Stress sub challenge is to predict the level of emotional arousal and valence in a time continuous manner from audio visual recordings and the goal of MuSe Physio sub challenge is to predict the level of psycho physiological arousal from a) human annotations fused with b) galvanic skin response (also known as Electrodermal Activity (EDA)) signals from the stressed people. The Ulm TSST dataset which is a novel subset of the audio visual textual Ulm Trier Social Stress dataset that features German speakers in a Trier Social Stress Test (TSST) induced stress situation is used in both sub challenges. For the MuSe Stress sub challenge, we highlight our solutions in three aspects 1) the audio visual features and the bio signal features are used for emotional state recognition. 2) the Long Short Term Memory (LSTM) with the self attention mechanism is utilized to capture complex temporal dependencies within the feature sequences. 3) the late fusion strategy is adopted to further boost the model's recognition performance by exploiting complementary information scattered across multimodal sequences. Our proposed model achieves CCC of 0.6159 and 0.4609 for valence and arousal respectively on the test set, which both rank in the top 3. For the MuSe Physio sub challenge, we first extract the audio visual features and the bio signal features from multiple modalities. Then, the LSTM module with the self attention mechanism, and the Gated Convolutional Neural Networks (GCNN) as well as the LSTM network are utilized for modeling the complex temporal dependencies in the sequence. Finally, the late fusion strategy is used. Our proposed method also achieves CCC of 0.5412 on the test set, which ranks in the top 3.


High purity solid parahydrogen. Alkali atoms trapped in solid hydrogen matrices have demonstrated ultralong electron spin coherence times, and are promising as quantum sensors. Their spin coherence is limited by magnetic noise from naturally occurring orthohydrogen molecules in the parahydrogen matrix. In the gas phase, the orthohydrogen component of hydrogen can be converted to parahydrogen by flowing it over a catalyst held at cryogenic temperatures, with lower temperatures giving a lower orthohydrogen fraction. In this work, we use a single cryostat to reduce the orthohydrogen fraction of hydrogen gas and grow a solid matrix from the resulting high purity parahydrogen. We demonstrate operation of the catalyst down to a temperature of 8 K, and we spectroscopically verify that orthohydrogen impurities in the resulting solid are at a level 1e 6. We also find that, at sufficiently low temperatures, the cryogenic catalyst provides isotopic purification, reducing the HD fraction.


Unsupervised Abstract Reasoning for Raven's Problem Matrices. Raven's Progressive Matrices (RPM) is highly correlated with human intelligence, and it has been widely used to measure the abstract reasoning ability of humans. In this paper, to study the abstract reasoning capability of deep neural networks, we propose the first unsupervised learning method for solving RPM problems. Since the ground truth labels are not allowed, we design a pseudo target based on the prior constraints of the RPM formulation to approximate the ground truth label, which effectively converts the unsupervised learning strategy into a supervised one. However, the correct answer is wrongly labelled by the pseudo target, and thus the noisy contrast will lead to inaccurate model training. To alleviate this issue, we propose to improve the model performance with negative answers. Moreover, we develop a decentralization method to adapt the feature representation to different RPM problems. Extensive experiments on three datasets demonstrate that our method even outperforms some of the supervised approaches. Our code is available at https github.com visiontao ncd.


Ninth variation of classical group characters of type A D and Littlewood identities. We introduce certain generalisations of the characters of the classical Lie groups, extending the recently defined factorial characters of Foley and King. This is done by replacing the factorial powers with a sequence of polynomials. In particular, we offer a ninth variation generalisation for the rational Schur functions. We derive Littlewood type identities for our generalisations.


Modeling the Sequential Dependence among Audience Multi step Conversions with Multi task Learning in Targeted Display Advertising. In most real world large scale online applications (e.g., e commerce or finance), customer acquisition is usually a multi step conversion process of audiences. For example, an impression click purchase process is usually performed of audiences for e commerce platforms. However, it is more difficult to acquire customers in financial advertising (e.g., credit card advertising) than in traditional advertising. On the one hand, the audience multi step conversion path is longer. On the other hand, the positive feedback is sparser (class imbalance) step by step, and it is difficult to obtain the final positive feedback due to the delayed feedback of activation. Multi task learning is a typical solution in this direction. While considerable multi task efforts have been made in this direction, a long standing challenge is how to explicitly model the long path sequential dependence among audience multi step conversions for improving the end to end conversion. In this paper, we propose an Adaptive Information Transfer Multi task (AITM) framework, which models the sequential dependence among audience multi step conversions via the Adaptive Information Transfer (AIT) module. The AIT module can adaptively learn what and how much information to transfer for different conversion stages. Besides, by combining the Behavioral Expectation Calibrator in the loss function, the AITM framework can yield more accurate end to end conversion identification. The proposed framework is deployed in Meituan app, which utilizes it to real timely show a banner to the audience with a high end to end conversion rate for Meituan Co Branded Credit Cards. Offline experimental results on both industrial and public real world datasets clearly demonstrate that the proposed framework achieves significantly better performance compared with state of the art baselines.


Hashing Accelerated Graph Neural Networks for Link Prediction. Networks are ubiquitous in the real world. Link prediction, as one of the key problems for network structured data, aims to predict whether there exists a link between two nodes. The traditional approaches are based on the explicit similarity computation between the compact node representation by embedding each node into a low dimensional space. In order to efficiently handle the intensive similarity computation in link prediction, the hashing technique has been successfully used to produce the node representation in the Hamming space. However, the hashing based link prediction algorithms face accuracy loss from the randomized hashing techniques or inefficiency from the learning to hash techniques in the embedding process. Currently, the Graph Neural Network (GNN) framework has been widely applied to the graph related tasks in an end to end manner, but it commonly requires substantial computational resources and memory costs due to massive parameter learning, which makes the GNN based algorithms impractical without the help of a powerful workhorse. In this paper, we propose a simple and effective model called GNN, which balances the trade off between accuracy and efficiency. GNN is able to efficiently acquire node representation in the Hamming space for link prediction by exploiting the randomized hashing technique to implement message passing and capture high order proximity in the GNN framework. Furthermore, we characterize the discriminative power of GNN in probability. The extensive experimental results demonstrate that the proposed GNN algorithm achieves accuracy comparable to the learning based algorithms and outperforms the randomized algorithm, while running significantly faster than the learning based algorithms. Also, the proposed algorithm shows excellent scalability on a large scale network with the limited resources.


Template Free Try on Image Synthesis via Semantic guided Optimization. The virtual try on task is so attractive that it has drawn considerable attention in the field of computer vision. However, presenting the three dimensional (3D) physical characteristic (e.g., pleat and shadow) based on a 2D image is very challenging. Although there have been several previous studies on 2D based virtual try on work, most 1) required user specified target poses that are not user friendly and may not be the best for the target clothing, and 2) failed to address some problematic cases, including facial details, clothing wrinkles and body occlusions. To address these two challenges, in this paper, we propose an innovative template free try on image synthesis (TF TIS) network. The TF TIS first synthesizes the target pose according to the user specified in shop clothing. Afterward, given an in shop clothing image, a user image, and a synthesized pose, we propose a novel model for synthesizing a human try on image with the target clothing in the best fitting pose. The qualitative and quantitative experiments both indicate that the proposed TF TIS outperforms the state of the art methods, especially for difficult cases.


Discovery of Causal Additive Models in the Presence of Unobserved Variables. Causal discovery from data affected by unobserved variables is an important but difficult problem to solve. The effects that unobserved variables have on the relationships between observed variables are more complex in nonlinear cases than in linear cases. In this study, we focus on causal additive models in the presence of unobserved variables. Causal additive models exhibit structural equations that are additive in the variables and error terms. We take into account the presence of not only unobserved common causes but also unobserved intermediate variables. Our theoretical results show that, when the causal relationships are nonlinear and there are unobserved variables, it is not possible to identify all the causal relationships between observed variables through regression and independence tests. However, our theoretical results also show that it is possible to avoid incorrect inferences. We propose a method to identify all the causal relationships that are theoretically possible to identify without being biased by unobserved variables. The empirical results using artificial data and simulated functional magnetic resonance imaging (fMRI) data show that our method effectively infers causal structures in the presence of unobserved variables.


Superevents Towards Native Semantic Segmentation for Event based Cameras. Most successful computer vision models transform low level features, such as Gabor filter responses, into richer representations of intermediate or mid level complexity for downstream visual tasks. These mid level representations have not been explored for event cameras, although it is especially relevant to the visually sparse and often disjoint spatial information in the event stream. By making use of locally consistent intermediate representations, termed as superevents, numerous visual tasks ranging from semantic segmentation, visual tracking, depth estimation shall benefit. In essence, superevents are perceptually consistent local units that delineate parts of an object in a scene. Inspired by recent deep learning architectures, we present a novel method that employs lifetime augmentation for obtaining an event stream representation that is fed to a fully convolutional network to extract superevents. Our qualitative and quantitative experimental results on several sequences of a benchmark dataset highlights the significant potential for event based downstream applications.


A Strong Law of Large Numbers for Positive Random Variables. In the spirit of the famous KOML 'OS (1967) theorem, every sequence of nonnegative, measurable functions f n n in N on a probability space, contains a subsequence which along with all its subsequences converges a.e. in CES ARO mean to some measurable f Omega to 0, infty . This result of VON WEIZS "ACKER (2004) is proved here using a new methodology and elementary tools these sharpen also a theorem of DELBAEN SCHACHERMAYER (1994), replacing general convex combinations by CES ARO means.


Safe screening rules for atomic norm regularization. Safe screening rules are algorithmic techniques meant to detect and safely discard unneeded variables during the solution process with the aim of accelerating computation. These techniques have been shown to be effective for one norm regularized problems. This paper generalizes the safe screening rule proposed by Ndiaye et al. J. Mach. Learn. Res., 2017 to various optimization problem formulations with atomic norm regularization. For nuclear norm regularized problems in particular, it is shown that the proposed generalized safe screening rule cannot safely reduce the problem size. In that case, approximation guarantees are developed that allows for reducing the problem size.


CPT Efficient Deep Neural Network Training via Cyclic Precision. Low precision deep neural network (DNN) training has gained tremendous attention as reducing precision is one of the most effective knobs for boosting DNNs' training time energy efficiency. In this paper, we attempt to explore low precision training from a new perspective as inspired by recent findings in understanding DNN training we conjecture that DNNs' precision might have a similar effect as the learning rate during DNN training, and advocate dynamic precision along the training trajectory for further boosting the time energy efficiency of DNN training. Specifically, we propose Cyclic Precision Training (CPT) to cyclically vary the precision between two boundary values which can be identified using a simple precision range test within the first few training epochs. Extensive simulations and ablation studies on five datasets and eleven models demonstrate that CPT's effectiveness is consistent across various models tasks (including classification and language modeling). Furthermore, through experiments and visualization we show that CPT helps to (1) converge to a wider minima with a lower generalization error and (2) reduce training variance which we believe opens up a new design knob for simultaneously improving the optimization and efficiency of DNN training. Our codes are available at https github.com RICE EIC CPT.


Cyclic Base Ordering of Graphs. A cyclic base ordering of a connected graph G , is a cyclic ordering of E(G) such that every cyclically consecutive V(G) 1 edges form a spanning tree. In this project, we study cyclic base ordering of various families of graphs, including square of cycles, wheel graphs, generalized wheel graphs and broken wheel graphs, fan and broken fan graphs, prism graphs, and maximal 2 degenerate graphs. We also provide a polynomial time algorithm to verify any giving edge ordering is a cyclic base ordering.


Generation of highly mutually coherent hard x ray pulse pairs with an amplitude splitting delay line. Beam splitters and delay lines are among the key building blocks of modern day optical laser technologies. Progress in x ray free electron laser source development and applications over the past decade is calling for their counter part operating in the Angstrom wavelength regime. Recent efforts in x ray optics development have demonstrated relatively stable delay lines that most often adopted the division of wavefront approach for the beam splitting and recombination configuration. However, the two recombined beams have yet to achieve sufficient mutual coherence to enable applications such as interferometry, correlation spectroscopy, and nonlinear spectroscopy. We present the first experimental realization of the generation of highly mutually coherent pulse pairs using an amplitude split delay line design based on transmission grating beam splitters and channel cut crystal optic delay lines. The performance of the prototype system was analyzed in the context of x ray coherent scattering and correlation spectroscopy, where we obtained nearly identical high contrast speckle patterns from both branches. We show in addition the high level of dynamical stability during continuous delay scans, a capability essential for high sensitivity ultra fast measurements.


Unbounded Mixed Resolvability of Web Graph and Prism Related Graph. Let mathbb E (H) and mathbb V (H) denote the edge set and the vertex set of the simple connected graph H , respectively. The mixed metric dimension of the graph H is the graph invariant, which is the mixture of two important graph parameters, the edge metric dimension and the metric dimension. In this article, we compute the mixed metric dimension for the two families of the plane graphs viz., the Web graph mathbb W n and the Prism allied graph mathbb D n t . We show that the mixed metric dimension is non constant unbounded for these two families of the plane graph. Moreover, for the Web graph mathbb W n and the Prism allied graph mathbb D n t , we unveil that the mixed metric basis set M G m is independent.


Regularity Estimates and Intrinsic Lions Derivative Formula for Singular McKean Vlasov SDEs. Regularity estimates and Bismut formula of L k ( k ge 1 ) intrinsic Lions derivative are presented for singular McKean Vlasov SDEs, where the noise coefficient belongs to a local Sobolev space, and the drift contains a locally integrable time space term as well as a time space distribution term Lipschitz continuous in the space and distribution variables. The results are new also for classical SDEs.


Automated stability testing of elastic rods with helical centerlines using a robotic system. Experimental analysis of the mechanics of a deformable object, and particularly its stability, requires repetitive testing and, depending on the complexity of the object's shape, a testing setup that can manipulate many degrees of freedom at the object's boundary. Motivated by recent advancements in robotic manipulation of deformable objects, this paper addresses these challenges by constructing a method for automated stability testing of a slender elastic rod a canonical example of a deformable object using a robotic system. We focus on rod configurations with helical centerlines since the stability of a helical rod can be described using only three parameters, but experimentally determining the stability requires manipulation of both the position and orientation at one end of the rod, which is not possible using traditional experimental methods that only actuate a limited number of degrees of freedom. Using a recent geometric characterization of stability for helical rods, we construct and implement a manipulation scheme to explore the space of stable helices, and we use a vision system to detect the onset of instabilities within this space. The experimental results obtained by our automated testing system show good agreement with numerical simulations of elastic rods in helical configurations. The methods described in this paper lay the groundwork for automation to grow within the field of experimental mechanics.


Approximate mathrm CVP in time 2 0.802 , n now in any norm!. We show that a constant factor approximation of the shortest and closest lattice vector problem in any norm can be computed in time 2 0.802 , n . This contrasts the corresponding 2 n time, (gap) SETH based lower bounds for these problems that even apply for small constant approximation. For both problems, mathrm SVP and mathrm CVP , we reduce to the case of the Euclidean norm. A key technical ingredient in that reduction is a twist of Milman's construction of an M ellipsoid which approximates any symmetric convex body K with an ellipsoid mathcal E so that 2 varepsilon n translates of a constant scaling of mathcal E can cover K and vice versa.


Visoes da Industria 4.0. Industry is part of an economy that produces highly mechanized and automated material goods. Since the beginning of industrialization, there have been several stages and paradigm shifts that today are ex post so called industrial revolutions in the field of mechanization (called the 1st industrial revolution), the intensive use of electrical energy (called the 2nd industrial revolution) and widespread digitization (called the 3rd industrial revolution). In this sense, for this future expectation, the term (Industry 4.0) was established for a 4th industrial revolution. Developments especially in Europe, but also in the United States, coined as the Industrial Internet, are often compared with the continuation of disruptive increases in industrial production, such as revolutions initiated by steam, electricity, etc. Aspects of continuous workforce training, and the use of sustainability resources in industrial, economic and general IT governance policies are not widespread and are the main problems and challenges in paradigms in Industry 4.0. Directions for future thematic research that will be covered in this article.


Efficient erbium doped thin film lithium niobate waveguide amplifiers. Lithium niobate on insulator (LNOI) is an emerging photonic platform with great promises for future optical communications, nonlinear optics and microwave photonics. An important integrated photonic building block, active waveguide amplifiers, however, is still missing in the LNOI platform. Here we report an efficient and compact waveguide amplifier based on erbium doped LNOI waveguides, realized by a sequence of erbium doped crystal growth, ion slicing and lithography based waveguide fabrication. Using a compact 5 mm long waveguide, we demonstrate on chip net gain of 5 dB for 1530 nm signal light with a relatively low pump power of 21 mW at 980 nm. The efficient LNOI waveguide amplifiers could become an important fundamental element in future lithium niobate photonic integrated circuits.


W 1,2 Bott Chern and Dolbeault decompositions on K "ahler manifolds. Let (M,J,g, omega) be a K "ahler manifold. We prove a W 1,2 weak Bott Chern decomposition and a W 1,2 weak Dolbeault decomposition, following the L 2 weak Kodaira decomposition on Riemannian manifolds. Moreover, if the K "ahler metric is complete and the sectional curvature is bounded, the W 1,2 Bott Chern decomposition is strictly related to the space of W 1,2 Bott Chern harmonic forms, i.e., W 1,2 smooth differential forms which are in the kernel of an elliptic differential operator of order 4 , called Bott Chern Laplacian. We also generalize to the non compact case the well known property that on compact K "ahler manifolds the kernel of the Dolbeault Laplacian and the kernel of the Bott Chern Laplacian coincide.


Relativistic time dependent configuration interaction singles. In this work, a derivation and implementation of the relativistic time dependent configuration interaction singles (RTDCIS) method is presented. Various observables for krypton and xenon atoms obtained by RTDCIS are compared with experimental data and alternative relativistic calculations. This includes energies of occupied orbitals in the Dirac Fock ground state, Rydberg state energies, Fano resonances and photoionization cross sections. Diagrammatic many body perturbation theory, based on the relativistic random phase approximation, is used as a benchmark with excellent agreement between RTDCIS reported at the Tamm Dancoff level. Results from RTDCIS are computed in the length gauge, here the negative energy states can be omitted with acceptable loss of accuracy. A complex absorbing potential, that is used to remove photoelectrons far from the ion, is implemented as a scalar potential and validated for RTDCIS. The RTDCIS methodology presented here opens for future studies of strong field processes, such as attosecond transient absorption and high order harmonic generation, with electron and hole spin dynamics and other relativistic effects described by first principle via the Dirac equation.


Fine grained Anomaly Detection via Multi task Self Supervision. Detecting anomalies using deep learning has become a major challenge over the last years, and is becoming increasingly promising in several fields. The introduction of self supervised learning has greatly helped many methods including anomaly detection where simple geometric transformation recognition tasks are used. However these methods do not perform well on fine grained problems since they lack finer features. By combining in a multi task framework high scale shape features oriented task with low scale fine features oriented task, our method greatly improves fine grained anomaly detection. It outperforms state of the art with up to 31 relative error reduction measured with AUROC on various anomaly detection problems.


DREAM Improving Situational QA by First Elaborating the Situation. When people answer questions about a specific situation, e.g., "I cheated on my mid term exam last week. Was that wrong?", cognitive science suggests that they form a mental picture of that situation before answering. While we do not know how language models (LMs) answer such questions, we conjecture that they may answer more accurately if they are also provided with additional details about the question situation, elaborating the "scene". To test this conjecture, we train a new model, DREAM, to answer questions that elaborate the scenes that situated questions are about, and then provide those elaborations as additional context to a question answering (QA) model. We find that DREAM is able to create better scene elaborations (more accurate, useful, and consistent) than a representative state of the art, zero shot model (Macaw). We also find that using the scene elaborations as additional context improves the answer accuracy of a downstream QA system, including beyond that obtainable by simply further finetuning the QA system on DREAM's training data. These results suggest that adding focused elaborations about a situation can improve a system's reasoning about it, and may serve as an effective way of injecting new scenario based knowledge into QA models. Finally, our approach is dataset neutral we observe improved QA performance across different models, with even bigger gains on models with fewer parameters. We make our dataset and model publicly available at https github.com allenai dream.


Complex valued deep learning with differential privacy. We present zeta DP, an extension of differential privacy (DP) to complex valued functions. After introducing the complex Gaussian mechanism, whose properties we characterise in terms of ( varepsilon, delta) DP and R 'enyi DP, we present zeta DP stochastic gradient descent ( zeta DP SGD), a variant of DP SGD for training complex valued neural networks. We experimentally evaluate zeta DP SGD on three complex valued tasks, i.e. electrocardiogram classification, speech classification and magnetic resonance imaging (MRI) reconstruction. Moreover, we provide zeta DP SGD benchmarks for a large variety of complex valued activation functions and on a complex valued variant of the MNIST dataset. Our experiments demonstrate that DP training of complex valued neural networks is possible with rigorous privacy guarantees and excellent utility.


Faking Brownian motion with continuous Markov martingales. Hamza Klebaner posed the problem of constructing martingales with Brownian marginals that differ from Brownian motion, so called fake Brownian motions. Besides its theoretical appeal, the problem represents the quintessential version of the ubiquitous fitting problem in mathematical finance where the task is to construct martingales that satisfy marginal constraints imposed by market data. Non continuous solutions to this challenge were given by Madan Yor, Hamza Klebaner, Hobson, and Fan Hamza Klebaner whereas continuous (but non Markovian) fake Brownian motions were constructed by Oleszkiewicz, Albin, Baker Donati Yor, Hobson, Jourdain Zhou. In contrast it is known from Gy "ongy, Dupire, and ultimately Lowther that Brownian motion is the unique continuous strong Markov martingale with Brownian marginals. We took this as a challenge to construct examples of a "very fake'' Brownian motion, that is, continuous Markov martingales with Brownian marginals that miss out only on the strong Markov property.


From the Beginning Key Transitions in the First 15 Years of DNSSEC. When the global rollout of the DNS Security Extensions (DNSSEC) began in 2005, it started a first of its kind trial increasing complexity of a core Internet protocol in favor of better security for the overall Internet. The necessary cryptographic key management is made particularly challenging by DNS' loosely federated delegation substrate and unprecedented cryptographic scale. Though fundamental for current and future operational success, our community lacks a clear notion of how to empirically evaluate the process of securely changing (or transitioning) keys. In this paper, we propose two building blocks to fundamentally understand and assess key transitions. First, the anatomy of key transitions measurable and well defined properties of key changes and second a novel classification model based on this anatomy to describe key transitions practices in abstract terms. Our anatomy enables the evaluation of cryptographic keys' life cycles in general, and comparison of operational practices with prescribed key management processes, e.g., RFC key rollover guidelines. The fine grained transition anatomy is then abstracted through our classification model to characterize transitions in abstract terms which rather describe a transition's behavior than its specific features. The applicability and utility of our proposed transition anatomy and transition classes are exemplified for the global DNSSEC deployment. Specifically, we use measurements from the first 15 years of the DNSSEC rollout to detect and measure which key rollover transitions have been used, to what degree, and what their rates of errors and warnings have been. Our results show measurable gaps between prescribed key management processes and key transitions in the wild. We also find evidence that such noncompliant transitions are inevitable in the wild.


Boundary feedback stabilization of a critical nonlinear JMGT equation with Neumann undissipated part of the boundary. Boundary feedback stabilization of a critical, nonlinear Jordan Moore Gibson Thompson (JMGT) equation is considered. JMGT arises in modeling of acoustic waves involved in medical engineering treatments like lithotripsy, thermotherapy, sonochemistry, or any other procedures using High Intensity Focused Ultrasound (HIFU). It is a well established and recently widely studied model for nonlinear acoustics (NLA) a third order (in time) semilinear Partial Differential Equation (PDE) with the distinctive feature of predicting the propagation of ultrasound waves at textit finite speed due to heat phenomenon know as textit second sound which leads to the hyperbolic character of heat propagation. In practice, the JMGT dynamics is largely used for modeling the evolution of the acoustic velocity and, most importantly, the acoustic pressure as sound waves propagate through certain media. Due to its sensitivity to different media, such model (or similar) is often used for medical engineering treatments such as lithotripsy, thermotherapy, sonochemistry, or any other procedures using High Intensity Focused Ultrasound (HIFU). In this work, emph critical refers to (usual) case where media damping effects are non existent or non measurable and therefore cannot be relied upon for stabilization purposes. In this paper the issue of boundary stabilizability of originally unstable (JMGT) equation is resolved. Motivated by modeling aspects in HIFU technology, boundary feedback is supported only on a portion of the boundary, while the remaining part of the boundary is left free (available to control actions) . Since the boundary conditions imposed on the "free" part of the boundary fail to satisfy Lopatinski condition (unlike Dirichlet boundary conditions), the analysis of uniform stabilization from the boundary becomes very subtle and requires careful geometric considerations.


On I eigenvalue free threshold graphs. A graph is said to be I eigenvalue free if it has no eigenvalues in the interval I with respect to the adjacency matrix A. In this paper we present two algorithms for generating I eigenvalue free threshold graphs.


A mathematical analysis of the Kakinuma model for interfacial gravity waves. Part I Structures and well posedness. We consider a model, which we named the Kakinuma model, for interfacial gravity waves. As is well known, the full model for interfacial gravity waves has a variational structure whose Lagrangian is an extension of Luke's Lagrangian for surface gravity waves, that is, water waves. The Kakinuma model is a system of Euler Lagrange equations for approximate Lagrangians, which are obtained by approximating the velocity potentials in the Lagrangian for the full model. In this paper, we first analyze the linear dispersion relation for the Kakinuma model and show that the dispersion curves highly fit that of the full model in the shallow water regime. We then analyze the linearized equations around constant states and derive a stability condition, which is satisfied for small initial data when the denser water is below the lighter water. We show that the initial value problem is in fact well posed locally in time in Sobolev spaces under the stability condition, the non cavitation assumption and intrinsic compatibility conditions in spite of the fact that the initial value problem for the full model does not have any stability domain so that its initial value problem is ill posed in Sobolev spaces. Moreover, it is shown that the Kakinuma model enjoys a Hamiltonian structure and has conservative quantities mass, total energy, and in the case of the flat bottom, momentum.


Computing efficiently the non properness set of polynomial maps on the plane. We introduce novel mathematical and computational tools to develop a complete and efficient algorithm for computing the set of non properness of polynomials maps in the plane. In particular, this set, which we call emph the Jelonek set , is a subset of mathbb K 2 where a dominant polynomial map f mathbb K 2 rightarrow mathbb K 2 is not proper mathbb K could be either mathbb C or mathbb R . Unlike all the previously known approaches we make no assumptions on f . The algorithm takes into account the sparsity of polynomials as it depends on (the Minkowski sum of) the Newton polytopes of f . As a byproduct we provide a finer representation of the set of non properness as a union of algebraic or semi algebraic sets, that correspond to edges of the Newton polytope, which is of independent interest. Finally, we present a precise Boolean complexity analysis of the algorithm and a prototype implementation in maple.


The Fixed Cycle Traffic Light queue with multiple lanes and temporary blockages. Traffic light modelling is a complex task, because many factors have to be taken into account. In particular, capturing all traffic flows in one model can significantly complicate the model. Therefore, several realistic features are typically omitted from most models. We introduce a mechanism to include pedestrians and focus on situations where they may block vehicles that get a green light simultaneously. More specifically, we consider a generalization of the Fixed Cycle Traffic Light (FCTL) queue. Our framework allows us to model situations where (part of the) vehicles are blocked, e.g. by pedestrians that block turning traffic and where several vehicles might depart simultaneously, e.g. in case of multiple lanes receiving a green light simultaneously. We rely on probability generating function and complex analysis techniques which are also used to study the regular FCTL queue. We study the effect of several parameters on performance measures such as the mean delay and queue length distribution.


A Dual arm Robot that Autonomously Lifts Up and Tumbles Heavy Plates Using Crane Pulley Blocks. This paper develops a planner that plans the action sequences and motion for a dual arm robot to lift up and flip heavy plates using crane pulley blocks. The problem is motivated by the low payload of modern collaborative robots. Instead of directly manipulating heavy plates that collaborative robots cannot afford, the paper develops a planner for collaborative robots to operate crane pulley blocks. The planner assumes a target plate is pre attached to the crane hook. It optimizes dual arm action sequences and plans the robot's dual arm motion that pulls the rope of the crane pulley blocks to lift up the plate. The crane pulley blocks reduce the payload that each robotic arm needs to bear. When the plate is lifted up to a satisfying pose, the planner plans a pushing motion for one of the robot arms to tumble over the plate while considering force and moment constraints. The article presents the technical details of the planner and several experiments and analysis carried out using a dual arm robot made by two Universal Robots UR3 arms. The influence of various parameters and optimization goals are investigated and compared in depth. The results show that the proposed planner is flexible and efficient.